-- Logs begin at Mon 2022-09-19 11:30:33 UTC, end at Mon 2022-09-19 12:50:12 UTC. -- Sep 19 12:17:07.962634 dv-cinder-850618-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 19 12:17:07.971150 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 19 12:17:07.973269 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 12:17:07 2022] *** Sep 19 12:17:07.973269 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 12:17:07.973269 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 12:17:07.973269 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: nodename: dv-cinder-850618-3-iscsi Sep 19 12:17:07.973269 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: machine: x86_64 Sep 19 12:17:07.973269 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: clock source: unix Sep 19 12:17:07.973269 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: pcre jit disabled Sep 19 12:17:07.973269 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: detected number of CPU cores: 4 Sep 19 12:17:07.973269 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: current working directory: / Sep 19 12:17:07.973269 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: detected binary path: /usr/bin/uwsgi-core Sep 19 12:17:07.973976 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: your processes number limit is 47680 Sep 19 12:17:07.973976 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: your memory page size is 4096 bytes Sep 19 12:17:07.973976 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: detected max file descriptor number: 2048 Sep 19 12:17:07.973976 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: lock engine: pthread robust mutexes Sep 19 12:17:07.973976 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: thunder lock: enabled Sep 19 12:17:07.973976 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 19 12:17:07.973976 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 12:17:08.012782 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: Python main interpreter initialized at 0x55e12cf969c0 Sep 19 12:17:08.012782 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: python threads support enabled Sep 19 12:17:08.012782 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: your server socket listen backlog is limited to 100 connections Sep 19 12:17:08.012782 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: your mercy for graceful operations on workers is 90 seconds Sep 19 12:17:08.013183 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 12:17:08.013183 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: *** Operational MODE: preforking *** Sep 19 12:17:08.013444 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: *** uWSGI is running in multiple interpreter mode *** Sep 19 12:17:08.013444 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: spawned uWSGI master process (pid: 106185) Sep 19 12:17:08.013645 dv-cinder-850618-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 19 12:17:08.017400 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: spawned uWSGI worker 1 (pid: 106186, cores: 1) Sep 19 12:17:08.017400 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: spawned uWSGI worker 2 (pid: 106187, cores: 1) Sep 19 12:17:08.017400 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 12:17:08.684650 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 12:17:08.688335 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 12:17:09.776821 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 12:17:09.776821 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: from cryptography.utils import int_from_bytes Sep 19 12:17:09.777438 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 12:17:09.777438 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: from cryptography.utils import int_from_bytes Sep 19 12:17:09.781800 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 12:17:09.781800 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: from cryptography.utils import int_from_bytes Sep 19 12:17:09.782220 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 12:17:09.782220 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: from cryptography.utils import int_from_bytes Sep 19 12:17:12.270134 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 12:17:12.270692 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 12:17:12.270783 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 12:17:12.271120 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 12:17:12.271204 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 12:17:12.271283 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 12:17:12.271485 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 12:17:12.271579 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 12:17:12.271846 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.271944 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 12:17:12.272099 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 12:17:12.272187 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.272464 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.272581 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.272828 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.272962 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.273149 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.273262 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.273453 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.273544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.273766 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.273854 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.274077 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.274165 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.274393 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.274487 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.274648 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.274738 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.274966 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.275066 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.275260 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.275347 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850618-3-iscsi {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.275853 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.275972 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.276138 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.276243 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850618-3-iscsi {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.276440 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.276543 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.276799 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.276913 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.277062 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.277156 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.277380 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.277480 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.277677 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.277782 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.277993 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.278180 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.278289 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.279511 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.279651 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.279726 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.279806 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.279873 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.279938 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.280010 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.280161 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.280237 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.280304 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.280376 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.280442 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.280783 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.281009 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.281240 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.281240 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.281635 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.281857 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.282064 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.282286 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.282496 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.282863 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850618-3-iscsi {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.283076 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.283272 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.283469 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850618-3-iscsi {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.283668 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.283885 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.283885 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.284236 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.284486 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.284720 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.284720 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.285134 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.285335 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.285510 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.285713 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.285868 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.286063 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.286212 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.286382 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.286528 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.286688 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.286834 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.286972 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.287153 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.287303 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.287441 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.287588 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.287765 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.287909 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.288058 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.288196 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.288335 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.288511 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.288702 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.288852 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.289128 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.289272 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.289420 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.289558 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.289696 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.289840 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.289977 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.290114 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.290260 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.290399 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.290537 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.290683 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.290826 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.290963 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.290963 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.291316 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.291456 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.291594 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.291734 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.291880 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.291880 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.292153 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.292290 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.292433 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.292581 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.292743 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.292893 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.293032 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.293169 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.293314 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.293461 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.293615 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.293763 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.293919 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.294063 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.294207 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.294353 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.294491 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.294635 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.294778 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.294927 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.295072 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.295222 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.295359 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.295507 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.295651 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.295806 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.295957 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.296103 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.296249 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.296386 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.296529 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.296742 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.296896 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.297036 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.297173 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.297310 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.297454 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.297591 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.297750 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.297904 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.298042 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.298186 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.298330 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.298467 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.298618 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.298618 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.298877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.298877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.299314 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.299470 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.299621 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.299771 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.299910 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.299910 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.300182 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.300329 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.300468 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.300622 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.300764 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.300764 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.301033 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.301184 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.301330 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.301478 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.301614 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.301751 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.301894 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.302044 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.302190 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.302190 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.302448 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.302586 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.302729 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.302875 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.303014 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.303159 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.303313 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.303451 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.303604 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.303749 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.303887 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.304031 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.304168 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.304305 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.304450 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.304587 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.304754 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.304903 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.305050 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.305199 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.305345 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.305489 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.305626 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.305763 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.305899 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.306041 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.306255 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.306408 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.306546 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.306791 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.306939 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.307085 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.307243 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.307383 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.307529 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.307667 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.307804 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.307940 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.308085 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.308224 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.308361 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.308498 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.308696 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.308840 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.308990 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.309138 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.309426 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.309571 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.309709 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.309846 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.309992 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.310130 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.310272 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.310410 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.310552 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.310698 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.310836 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.310990 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.311128 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.311272 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.311417 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.311563 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.311716 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.311854 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.311991 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.312136 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.312273 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.312419 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.312565 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.312762 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.312924 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.313063 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.313207 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.313856 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.314014 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.314152 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.314289 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.314427 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.314574 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.314718 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.314854 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.314991 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.315135 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.315283 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.315433 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.315572 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.315709 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.315846 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.315982 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.316131 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.316276 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.316414 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.316551 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:17:12.316733 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.316880 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.317025 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.317187 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.317327 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.317471 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.317608 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.317746 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.317892 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.318038 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.318176 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.318313 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.318450 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.318588 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.318798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.318950 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.319088 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.319225 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.319499 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.319645 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.319794 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.319940 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.320078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.320214 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.320371 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.320523 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.320694 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.320845 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.321004 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.321149 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.321287 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.321424 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.321570 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.321716 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.321855 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.321992 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.322130 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.322280 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.322431 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.322569 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.322716 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.322854 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.323016 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.323175 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.323324 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.323470 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.323608 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.323745 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.323883 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.324034 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.324179 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.324324 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.324462 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.324666 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.324812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.324966 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.325106 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.325250 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.325393 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.325531 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.325703 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.325856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.326004 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.326149 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.326287 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.326434 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.326662 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.326802 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.326940 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.327078 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.327215 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.327352 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.327509 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.327648 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.327814 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.327991 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.328143 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.328288 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.328440 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.328589 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.328766 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.328904 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.329073 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.329829 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.329986 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.330126 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.330264 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.330401 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.330538 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.330683 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.330821 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.330981 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.331120 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.331258 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.331394 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.331539 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.331684 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.331821 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.331957 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.332100 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.332239 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.332384 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.332522 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.332727 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.332880 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.333034 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.333173 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.333318 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.333458 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.333595 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.333731 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.333951 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.334091 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.334237 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.334376 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.334514 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.334652 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.334799 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.334944 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.335090 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.335235 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.335373 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.335510 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.335669 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.335821 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.335977 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.336128 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.336266 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.336410 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.336555 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.336741 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.336881 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.337020 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.337156 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.337293 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.337429 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.337576 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.337715 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.337851 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.337851 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.338116 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.338263 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.338401 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.338548 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.338693 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.338831 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.338976 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.339122 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.339261 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.339398 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.339534 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.339710 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.339867 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.340020 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.340159 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.340305 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.340450 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.340587 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.340775 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.340923 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.341061 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.341198 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.341335 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.341479 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.341626 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.341765 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.341902 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.342039 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.342192 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.342338 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.342489 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.342626 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.342771 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.342917 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.343055 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.343192 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.343342 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.343480 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.343617 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.343754 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.343893 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.344054 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.344201 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.344339 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.344476 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.344636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.344780 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.344930 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.345070 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.345207 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.345345 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.345481 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.345625 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.345790 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.345947 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.346087 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.346225 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.346362 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.346499 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.346649 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.346789 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.346932 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.347079 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.347217 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.347362 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.347509 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.347656 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.347801 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.347945 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.348089 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.348236 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.348374 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.348511 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.348713 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.348858 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.349004 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.349161 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.349307 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.349451 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.349605 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.349750 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.349894 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.350046 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.350191 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.350343 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.350487 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.350630 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.350773 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.350963 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.351112 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.351264 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.351408 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.351563 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.351716 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.351861 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.352005 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.352149 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.352294 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.352438 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.352590 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.352773 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.352918 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.353061 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.353205 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.353351 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.353513 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.353659 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.353802 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.353960 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.354104 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.354247 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.354467 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.354616 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.354760 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.354903 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.355047 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.355191 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.355363 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.355516 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.355660 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.355660 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.355952 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.356110 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.356256 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.356407 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.356559 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.356764 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.356909 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.357070 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.357216 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.357377 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.357523 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.357667 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.357811 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.357962 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.358118 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.358272 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.358417 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.358562 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.358706 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.358862 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.359008 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.359158 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.359312 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.359457 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.359613 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.359759 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.359902 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.360046 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.360189 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.360346 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.360500 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.360669 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.360819 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.360963 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.361106 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.361260 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.361424 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.361569 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.361714 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.361859 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.362002 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.362146 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.362297 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.362441 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.362585 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.362729 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.362873 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.363025 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.363180 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.363330 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.363481 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.363626 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.363771 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.363923 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.364068 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.364213 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.364356 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.364499 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.364672 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.364836 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.364998 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.365150 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.365295 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.365439 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.365590 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.365757 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.365905 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.366056 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.366201 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.366352 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.366497 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.366649 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.366800 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.366956 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.367108 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.367259 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.367413 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.367557 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.367708 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.367852 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.368004 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.368156 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.368309 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.368453 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.368626 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.368778 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.368932 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.369088 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.369246 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.369392 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.369542 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.369693 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.369838 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.369987 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.370142 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.370290 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.370441 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.370586 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.370739 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.370910 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.371055 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.371200 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.371344 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.371495 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.371712 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.371881 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.372028 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.372173 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.372173 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.372444 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.372615 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.372787 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.372945 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.373089 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.373234 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.373378 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.373522 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.373673 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.373818 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.373963 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.374113 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.374259 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.374417 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.374562 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.374725 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.374870 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.375015 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.375165 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.375165 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.375455 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.375610 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.375758 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.376424 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.376662 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.376828 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.376976 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.377120 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.377285 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.377442 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.377596 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.377742 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.377895 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.378041 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.378186 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.378331 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.378476 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.378629 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.378782 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.378927 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.379081 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.379248 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.379395 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.379540 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.379684 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.379684 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.379965 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.380109 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.380253 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.380396 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.380541 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.380726 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.380874 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.381029 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.381185 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.381338 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.381491 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.381638 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.381782 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.381934 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.382079 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.382224 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.382380 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.382525 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.382669 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.382813 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.382968 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.383126 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.383284 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.383437 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.383589 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.383735 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.383886 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.384030 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.384183 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.384328 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.384472 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.384669 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.384821 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.384989 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.385135 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.385278 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.385424 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.385576 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.385722 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.385876 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.386022 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.386022 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.386301 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.386446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.386591 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.386744 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.386906 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.387051 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.387196 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.387339 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.387492 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.387492 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.387765 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.387910 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.388054 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.388204 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.388363 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.388509 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.388700 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.388848 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.388994 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.389138 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.389291 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.389436 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.389587 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.389739 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.389883 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.390028 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.390181 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.390334 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.390479 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.390634 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.390779 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.390937 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.391083 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.391227 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.391371 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.391514 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.392202 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.392365 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.392512 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.392702 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.392859 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.393012 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.393223 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.393378 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.393530 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.393682 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.393833 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.393977 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.394121 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.394274 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.394420 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.394563 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.394707 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.394851 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.395003 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.395159 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.395311 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.395466 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.395612 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.395756 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.395908 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.396061 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.396206 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.396351 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.396494 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.396671 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.396843 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.397000 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.397145 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.397288 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.397433 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.397576 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.397729 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.397875 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.398019 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.398163 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.398307 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.398527 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.398683 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.398829 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.398988 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.399133 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.399278 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.399431 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.399577 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.399727 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.399873 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.400061 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.400222 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.400376 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.400797 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.400979 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.401179 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.401339 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.401485 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.401639 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.401784 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.401928 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.402081 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.402227 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.402379 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.402525 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.402678 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.402822 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.402965 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.403108 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.403272 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.403418 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.403563 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.403708 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.403859 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.404009 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.404166 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.404311 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.404456 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.404647 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.404811 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.404964 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.405117 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.405278 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.405434 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.405578 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.405724 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.405877 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.406023 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.406173 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.406327 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.406473 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.406616 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.406837 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.406985 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.407163 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.407313 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.407465 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.407609 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.407762 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.407908 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.408052 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.408203 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.408348 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.408491 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.408672 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.408824 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.408976 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.409131 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.409277 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.409422 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.409577 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.409723 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.409873 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.410018 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.410163 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.410314 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.410459 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.410603 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.410746 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.410932 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.411095 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.411248 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.411394 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.411545 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.411690 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.411835 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.411978 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.412131 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.412276 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.412419 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.412563 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.412763 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.412919 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.413095 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.413242 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.413393 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.413537 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.413688 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.413840 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.413986 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.414130 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.414275 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.414419 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.414571 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.414724 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.414869 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.415023 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.415175 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.415329 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.415486 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.415640 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.415785 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.415929 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.416073 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.416218 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.416362 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.416514 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.416685 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.416843 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.416987 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.417130 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.417291 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.417437 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.417580 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.417731 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.417731 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.418013 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.418013 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.418300 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.418444 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.418595 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.418749 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.418901 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.419055 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.419208 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.419353 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.419497 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.419640 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.419784 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.419936 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.420080 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.420231 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.420376 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.420376 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.420694 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.420694 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.420970 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.421114 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.421258 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.421410 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.421564 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.421709 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.421852 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.421996 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.422140 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.422283 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.422449 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.422597 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.423262 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.423262 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.423544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.423688 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.423841 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.423986 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.424130 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.424274 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.424417 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.424569 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.424763 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.424920 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.425076 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.425229 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.425373 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.425373 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.425661 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.425809 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.425953 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.426096 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.426239 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.426391 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.426535 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.426687 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.426842 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.426986 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.427129 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.427285 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.427437 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.427437 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.427715 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.427715 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.427996 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.428229 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.428385 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.428385 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.428702 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.428897 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.429047 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.429192 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.429348 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.429493 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.429637 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.429781 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.429926 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.430076 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.430229 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.430375 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.430518 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.430673 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.430818 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.430975 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.431133 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.431279 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.431422 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.431567 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.431710 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.431862 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.432017 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.432162 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.432312 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.432456 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.432661 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.432830 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.432979 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.433124 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.433268 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.433419 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.433564 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.433716 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.433861 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.434005 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.434150 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.434294 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.434438 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.434601 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.434753 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.434898 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.435041 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.435194 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.435347 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.435500 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.435655 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.435800 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.435950 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.436094 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.436247 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.436409 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.436561 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.436731 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.436877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.437152 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.437317 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.437464 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.437609 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.437754 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.437906 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.438052 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.438209 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.438383 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.439069 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.439216 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.439362 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.439508 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.439667 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.439848 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.439997 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.440141 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.440285 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.440443 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.440589 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.440851 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.440851 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.441127 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.441127 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.441301 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.441390 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.441472 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.441554 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.441640 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.441722 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.441817 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.441906 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.442017 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.442104 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.442185 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.442265 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.442354 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.442446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.442529 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.442621 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.442704 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.442811 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.442896 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.442977 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.443057 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.443137 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.443217 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.443306 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.443389 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.443485 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.443567 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.443567 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.443713 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.443870 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.443963 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.444053 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.444135 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.444216 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.444296 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.444441 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.444643 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.444808 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.444962 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.445107 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.445259 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.445405 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.445550 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.445695 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.445839 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.445990 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.446144 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.446290 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.446434 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.446589 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.446734 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.446878 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.447031 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.447181 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.447331 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.447475 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.447619 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.447772 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.447927 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.448071 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.448216 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.448360 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.448514 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.448703 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.448855 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.448999 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.449151 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.449295 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.449440 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.449596 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.449748 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.449901 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.450044 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.450194 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.450348 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.450501 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.450659 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.450806 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.450950 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.451094 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.451238 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.451392 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.451545 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.451690 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.451834 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.451992 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.452144 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.452299 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.452444 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.452616 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.452812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.452975 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.453131 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.453277 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.453450 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.453629 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.453783 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.453927 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.454106 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.454253 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.454408 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.454552 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.454705 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.454856 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.455015 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.455196 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.455354 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.455527 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.455685 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.455838 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.455989 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.456136 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.456290 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.456443 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.456651 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.456825 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.456971 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.457117 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.457281 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.457431 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.457575 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.457728 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.457880 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.458032 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.458189 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.458334 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.458493 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.458639 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.458791 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.458943 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.459095 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.459241 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.459394 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.459540 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.459692 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.459844 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.460000 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.460153 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.460307 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.460451 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.460642 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.460807 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.460954 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.461110 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.461253 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.461402 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.461554 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.461700 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.461863 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.462017 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.462163 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.462308 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.462453 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.462597 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.462749 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.462894 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.463039 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.463183 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.463326 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.463479 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.463646 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.463800 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.463951 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.464097 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.464242 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.464386 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.464543 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.464715 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.464859 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.465004 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.465199 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.465452 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.465668 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.465907 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.466134 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.466386 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.466626 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.466882 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.467122 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.467368 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.467618 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.467859 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.468098 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.468098 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.468554 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.468912 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.469160 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.469407 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.469690 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.469936 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.470175 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.470407 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.470612 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.470834 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.471071 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.471292 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.471466 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.471613 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.471840 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.472012 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.472176 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.472323 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.472467 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.472641 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.472796 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.472796 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.473085 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.473085 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.473376 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.473523 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.473666 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.473902 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.474052 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.474197 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.474341 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.474494 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.474640 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.474798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.474945 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.475097 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.475243 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.475388 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.475532 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.475694 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.475694 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.475977 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.476122 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.476266 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.476411 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.476564 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.476764 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.476910 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.477055 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.477210 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.477366 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.477511 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.477675 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.477821 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.477965 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.478110 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.478263 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.478408 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.478553 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.478704 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.478849 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.478993 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.479148 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.479294 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.479439 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.479593 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.479738 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.479889 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.480043 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.480198 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.480344 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.480489 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.480656 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.480818 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.480964 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.481108 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.481263 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.481409 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.481571 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.481725 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.481871 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.482015 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.482160 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.482304 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.482497 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.482653 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.482799 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.482942 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.483087 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.483232 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.483395 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.483550 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.483696 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.483840 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.483985 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.484129 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.484283 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.484436 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.484580 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.484752 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.484908 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.485053 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.485733 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.485907 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.486063 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.486215 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.486361 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.486506 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.486665 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.486811 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.486811 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.487084 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.487237 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.487382 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.487535 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.487691 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.487847 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.487992 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.488144 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.488298 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.488443 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.488589 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.488877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.489026 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.489172 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.489347 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.489558 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.489709 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.489709 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.489994 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.490147 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.490305 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.490452 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.490596 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.490741 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.490884 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.491037 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.491182 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.491325 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.491476 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.491621 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.491777 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.491930 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.492075 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.492219 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.492371 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.492516 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.492697 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.492856 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.493009 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.493155 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.493306 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.493458 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.493611 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.493808 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.493961 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.494107 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.494252 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.494406 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.494561 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.494707 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.494859 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.495005 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.495149 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.495294 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.495446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.495609 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.495755 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.495901 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.496045 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.496190 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.496342 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.496489 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.496671 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.496822 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.496979 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.497134 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.497280 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.497432 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.497595 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.497745 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.497745 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.498035 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.498035 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.498035 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.498437 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.498581 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.498726 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.498878 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.499023 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.499169 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.499327 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.499471 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.499623 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.499768 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.499911 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.500055 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.500201 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.500346 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.500503 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.500671 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.500831 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.500831 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.501675 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.501823 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.501982 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.502136 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.502282 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.502427 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.502612 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.502835 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.502991 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.503145 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.503145 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.503420 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.503564 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.503728 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.503874 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.504019 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.504163 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.504316 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.504461 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.504698 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.504852 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.504998 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.505159 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.505304 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.505458 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.505615 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.505760 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.505904 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.506048 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.506192 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.506345 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.506498 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.506643 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.506787 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.506932 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.507075 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.507228 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.507380 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.507537 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.507834 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.507983 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.508128 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.508288 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.508435 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.508581 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.508755 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.508901 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.509058 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.509204 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.509349 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.509494 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.509662 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.509808 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.509967 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.510113 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.510257 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.510402 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.510553 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.510553 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.510837 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.510991 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.510991 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.511273 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.511428 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.511572 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.511726 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.511880 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.512025 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.512169 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.512314 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.512466 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.512659 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.512812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.512957 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.513102 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.513245 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.513245 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.513549 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.513549 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.513823 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.513968 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.514121 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.514275 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.514420 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.514565 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.514709 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.514854 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.514998 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.515151 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.515308 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.515462 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.515607 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.515751 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.515905 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.516050 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.516195 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.516347 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.516493 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.516690 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.516848 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.516994 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.517152 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.517304 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.517457 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.517608 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.517766 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.517920 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.518066 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.518212 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.518356 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.518508 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.518654 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.518798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.518944 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.519099 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.519244 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.519401 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.519547 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.519691 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.519835 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.519979 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.520124 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.520277 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.520422 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.520567 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.520754 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.520910 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.521067 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.521213 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.521358 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.521510 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.521655 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.521800 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.521953 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.522106 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.522251 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.522395 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.522548 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.522703 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.522860 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.523006 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.523151 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.523296 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.523440 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.523591 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.523746 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.523899 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.524044 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.524189 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.524334 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.524487 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.524677 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.524828 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.524972 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.525125 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.525271 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.525425 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.525831 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.525980 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.526124 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.526268 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 12:17:12.526415 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.526415 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.526415 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.526415 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.526415 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.526415 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.526415 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.526415 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:17:12.527515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 12:17:12.677612 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO dbcounter [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] Registered counter for database nova_api Sep 19 12:17:12.679603 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO dbcounter [None req-1bed89d1-dc46-4b20-aa29-41df9ecd2684 None None] Registered counter for database nova_api Sep 19 12:17:12.699476 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_db.sqlalchemy.engines [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 12:17:12.701299 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG oslo_db.sqlalchemy.engines [None req-1bed89d1-dc46-4b20-aa29-41df9ecd2684 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 12:17:12.706174 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG dbcounter [-] [106187] Writer thread running {{(pid=106187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 12:17:12.708737 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG dbcounter [-] [106186] Writer thread running {{(pid=106186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 12:17:12.763108 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.context [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f85a1a4f-73ae-4199-a51b-3478744f2b7e(cell1) {{(pid=106187) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 12:17:12.765013 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.context [None req-1bed89d1-dc46-4b20-aa29-41df9ecd2684 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f85a1a4f-73ae-4199-a51b-3478744f2b7e(cell1) {{(pid=106186) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 12:17:12.767039 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:12.767514 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:12.768875 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG oslo_concurrency.lockutils [None req-1bed89d1-dc46-4b20-aa29-41df9ecd2684 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:12.769099 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:12.769348 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG oslo_concurrency.lockutils [None req-1bed89d1-dc46-4b20-aa29-41df9ecd2684 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:12.769815 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:12.770259 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:12.770894 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG oslo_concurrency.lockutils [None req-1bed89d1-dc46-4b20-aa29-41df9ecd2684 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:12.771615 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG oslo_concurrency.lockutils [None req-1bed89d1-dc46-4b20-aa29-41df9ecd2684 None None] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:12.772058 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG oslo_concurrency.lockutils [None req-1bed89d1-dc46-4b20-aa29-41df9ecd2684 None None] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:12.772237 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:12.774047 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG oslo_concurrency.lockutils [None req-1bed89d1-dc46-4b20-aa29-41df9ecd2684 None None] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:12.774226 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO dbcounter [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] Registered counter for database nova_cell0 Sep 19 12:17:12.776303 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO dbcounter [None req-1bed89d1-dc46-4b20-aa29-41df9ecd2684 None None] Registered counter for database nova_cell0 Sep 19 12:17:12.778524 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO dbcounter [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] Registered counter for database nova_cell1 Sep 19 12:17:12.780558 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO dbcounter [None req-1bed89d1-dc46-4b20-aa29-41df9ecd2684 None None] Registered counter for database nova_cell1 Sep 19 12:17:12.786501 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_db.sqlalchemy.engines [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 12:17:12.788129 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_db.sqlalchemy.engines [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 12:17:12.790378 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG oslo_db.sqlalchemy.engines [None req-1bed89d1-dc46-4b20-aa29-41df9ecd2684 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 12:17:12.792183 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG oslo_db.sqlalchemy.engines [None req-1bed89d1-dc46-4b20-aa29-41df9ecd2684 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 12:17:12.793676 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG dbcounter [-] [106187] Writer thread running {{(pid=106187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 12:17:12.798747 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG dbcounter [-] [106186] Writer thread running {{(pid=106186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 12:17:12.799495 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG dbcounter [-] [106187] Writer thread running {{(pid=106187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 12:17:12.801062 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG dbcounter [-] [106186] Writer thread running {{(pid=106186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 12:17:12.945201 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO dbcounter [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] Registered counter for database nova_cell0 Sep 19 12:17:12.949641 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO dbcounter [None req-1bed89d1-dc46-4b20-aa29-41df9ecd2684 None None] Registered counter for database nova_cell0 Sep 19 12:17:12.955218 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_db.sqlalchemy.engines [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 12:17:12.960794 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG oslo_db.sqlalchemy.engines [None req-1bed89d1-dc46-4b20-aa29-41df9ecd2684 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 12:17:12.961389 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG dbcounter [-] [106187] Writer thread running {{(pid=106187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 12:17:12.966238 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG dbcounter [-] [106186] Writer thread running {{(pid=106186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 12:17:13.417185 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: WARNING keystonemiddleware.auth_token [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 12:17:13.424506 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: WARNING keystonemiddleware.auth_token [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 12:17:13.458882 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: WARNING keystonemiddleware.auth_token [None req-1bed89d1-dc46-4b20-aa29-41df9ecd2684 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 12:17:13.467935 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: WARNING keystonemiddleware.auth_token [None req-1bed89d1-dc46-4b20-aa29-41df9ecd2684 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 12:17:13.763960 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: WARNING keystonemiddleware.auth_token [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 12:17:13.770390 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: WARNING keystonemiddleware.auth_token [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 12:17:13.775931 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e12cf969c0 pid: 106187 (default app) Sep 19 12:17:13.777977 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:13.779148 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] 10.222.0.93 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001698 Sep 19 12:17:13.779556 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 1/1] 10.222.0.93 () {50 vars in 788 bytes} [Mon Sep 19 12:17:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:17:13.805546 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: WARNING keystonemiddleware.auth_token [None req-1bed89d1-dc46-4b20-aa29-41df9ecd2684 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 12:17:13.811505 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: WARNING keystonemiddleware.auth_token [None req-1bed89d1-dc46-4b20-aa29-41df9ecd2684 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 12:17:13.817361 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e12cf969c0 pid: 106186 (default app) Sep 19 12:18:39.556356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:39.557471 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001634 Sep 19 12:18:39.557877 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 2/2] 10.222.0.93 () {54 vars in 931 bytes} [Mon Sep 19 12:18:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:18:39.571984 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG dbcounter [-] [106186] Writing DB stats nova_api:SELECT=3 {{(pid=106186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:39.572937 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG dbcounter [-] [106186] Writing DB stats nova_cell0:SELECT=3 {{(pid=106186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:39.574060 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG dbcounter [-] [106186] Writing DB stats nova_cell1:SELECT=3 {{(pid=106186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:39.576151 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG dbcounter [-] [106186] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:40.477629 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-8e14d1d2-4e72-494c-9b0c-c217348f9407 admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:40.512823 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-8e14d1d2-4e72-494c-9b0c-c217348f9407 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.946185 Sep 19 12:18:40.513711 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 1/3] 10.222.0.93 () {60 vars in 1292 bytes} [Mon Sep 19 12:18:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:18:43.361649 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:43.362562 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-ca3d7984-9986-4fd8-9367-d7b7fdf016ed None None] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 19 12:18:43.363241 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 3/4] 10.222.0.93 () {54 vars in 931 bytes} [Mon Sep 19 12:18:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:18:43.975484 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-3cf7fca8-f222-4f0c-abc9-9b26eeaff331 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "ram": 256, "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "disk": 1}} {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:18:44.218385 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-3cf7fca8-f222-4f0c-abc9-9b26eeaff331 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.845519 Sep 19 12:18:44.218976 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 2/5] 10.222.0.93 () {64 vars in 1283 bytes} [Mon Sep 19 12:18:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:18:44.233792 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG dbcounter [-] [106187] Writing DB stats nova_api:SELECT=3 {{(pid=106187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:44.234825 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG dbcounter [-] [106187] Writing DB stats nova_cell0:SELECT=3 {{(pid=106187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:44.237490 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG dbcounter [-] [106187] Writing DB stats nova_cell1:SELECT=3 {{(pid=106187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:44.238716 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG dbcounter [-] [106187] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:44.452153 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-c5f5c09a-1741-4243-9be5-be5fb0532aa5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:18:44.644238 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-c5f5c09a-1741-4243-9be5-be5fb0532aa5 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.416453 Sep 19 12:18:44.645173 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 4/6] 10.222.0.93 () {64 vars in 1336 bytes} [Mon Sep 19 12:18:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:47.527932 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-3cf7fca8-f222-4f0c-abc9-9b26eeaff331 admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:47.528991 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-3cf7fca8-f222-4f0c-abc9-9b26eeaff331 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 19 12:18:47.530011 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 3/7] 10.222.0.93 () {54 vars in 931 bytes} [Mon Sep 19 12:18:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:18:48.363331 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-5b0bc6ac-bbee-46e1-ad75-02e3342eb5d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "disk": 5, "vcpus": 1, "id": "d1", "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:18:48.534817 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-5b0bc6ac-bbee-46e1-ad75-02e3342eb5d8 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.995308 Sep 19 12:18:48.535442 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 5/8] 10.222.0.93 () {64 vars in 1283 bytes} [Mon Sep 19 12:18:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:18:48.550508 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-e5e52421-00ef-4460-979f-70a2c34347a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:18:48.657843 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-e5e52421-00ef-4460-979f-70a2c34347a9 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112347 Sep 19 12:18:48.658611 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 4/9] 10.222.0.93 () {64 vars in 1336 bytes} [Mon Sep 19 12:18:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:18:51.362978 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-5b0bc6ac-bbee-46e1-ad75-02e3342eb5d8 admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:51.364007 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-5b0bc6ac-bbee-46e1-ad75-02e3342eb5d8 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Sep 19 12:18:51.364412 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 6/10] 10.222.0.93 () {54 vars in 931 bytes} [Mon Sep 19 12:18:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:18:51.804317 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-4aabd4a3-63a4-437f-a6a2-da3e22ecda0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "swap": 0, "id": "d2", "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:18:51.956119 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-4aabd4a3-63a4-437f-a6a2-da3e22ecda0c admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.585293 Sep 19 12:18:51.956718 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 5/11] 10.222.0.93 () {64 vars in 1283 bytes} [Mon Sep 19 12:18:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:18:51.969767 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-d0cdb77c-29e2-4d21-9e17-2c7f9d7288c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:18:52.102900 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-d0cdb77c-29e2-4d21-9e17-2c7f9d7288c0 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.137468 Sep 19 12:18:52.103482 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 7/12] 10.222.0.93 () {64 vars in 1336 bytes} [Mon Sep 19 12:18:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:54.824296 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-4aabd4a3-63a4-437f-a6a2-da3e22ecda0c admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:54.824296 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-4aabd4a3-63a4-437f-a6a2-da3e22ecda0c admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Sep 19 12:18:54.825431 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 6/13] 10.222.0.93 () {54 vars in 931 bytes} [Mon Sep 19 12:18:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:18:55.373270 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-fd648141-5df8-4713-a091-ee8c784bef19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "disk": 10}} {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:18:55.454180 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-fd648141-5df8-4713-a091-ee8c784bef19 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.620822 Sep 19 12:18:55.455212 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 8/14] 10.222.0.93 () {64 vars in 1283 bytes} [Mon Sep 19 12:18:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:18:55.475380 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-e5eed5ec-8476-4f3f-af3a-818e275c2735 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:18:55.559900 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-e5eed5ec-8476-4f3f-af3a-818e275c2735 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090447 Sep 19 12:18:55.561458 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 7/15] 10.222.0.93 () {64 vars in 1336 bytes} [Mon Sep 19 12:18:55 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:58.376501 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-fd648141-5df8-4713-a091-ee8c784bef19 admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:58.377560 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-fd648141-5df8-4713-a091-ee8c784bef19 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Sep 19 12:18:58.377968 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 9/16] 10.222.0.93 () {54 vars in 931 bytes} [Mon Sep 19 12:18:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:18:58.855398 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-7b190e1e-74ee-47a7-834c-f2fc64ccb6b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "os-flavor-access:is_public": true, "name": "ds4G", "disk": 20, "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:18:58.945219 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-7b190e1e-74ee-47a7-834c-f2fc64ccb6b1 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.561100 Sep 19 12:18:58.945847 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 8/17] 10.222.0.93 () {64 vars in 1283 bytes} [Mon Sep 19 12:18:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:18:58.958310 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-2446feb3-b0d6-44a5-8746-db6dd836712c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:18:59.062239 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-2446feb3-b0d6-44a5-8746-db6dd836712c admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107657 Sep 19 12:18:59.062847 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 10/18] 10.222.0.93 () {64 vars in 1336 bytes} [Mon Sep 19 12:18:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:02.440234 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-7b190e1e-74ee-47a7-834c-f2fc64ccb6b1 admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:02.441319 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-7b190e1e-74ee-47a7-834c-f2fc64ccb6b1 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Sep 19 12:19:02.441736 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 9/19] 10.222.0.93 () {54 vars in 931 bytes} [Mon Sep 19 12:19:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:19:02.889545 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-e78df3fe-b0d3-4822-9f41-d4c2fc17c580 admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:02.915223 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-e78df3fe-b0d3-4822-9f41-d4c2fc17c580 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.466731 Sep 19 12:19:02.915929 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 11/20] 10.222.0.93 () {60 vars in 1292 bytes} [Mon Sep 19 12:19:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:05.646490 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-7b190e1e-74ee-47a7-834c-f2fc64ccb6b1 admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:05.647615 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-7b190e1e-74ee-47a7-834c-f2fc64ccb6b1 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001791 Sep 19 12:19:05.648160 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 10/21] 10.222.0.93 () {54 vars in 931 bytes} [Mon Sep 19 12:19:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:19:06.145910 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-bde22455-a5bb-4a16-ab39-82717a00bad3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "name": "m1.tiny"}} {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:06.302417 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-bde22455-a5bb-4a16-ab39-82717a00bad3 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.646967 Sep 19 12:19:06.303449 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 12/22] 10.222.0.93 () {64 vars in 1283 bytes} [Mon Sep 19 12:19:05 2022] POST /compute/v2.1/flavors => generated 402 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:19:06.320585 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-77611d2d-00d9-4297-bb98-0899f5a678a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:06.456693 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-77611d2d-00d9-4297-bb98-0899f5a678a1 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.139934 Sep 19 12:19:06.457287 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 11/23] 10.222.0.93 () {64 vars in 1333 bytes} [Mon Sep 19 12:19:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:09.206681 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-bde22455-a5bb-4a16-ab39-82717a00bad3 admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:09.209349 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-bde22455-a5bb-4a16-ab39-82717a00bad3 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002966 Sep 19 12:19:09.210281 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 13/24] 10.222.0.93 () {54 vars in 931 bytes} [Mon Sep 19 12:19:09 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:19:09.725499 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-77d0e2c5-defd-46e2-9d68-44ce51a7d15b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.small", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:09.732965 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG dbcounter [-] [106186] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:09.860160 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-77d0e2c5-defd-46e2-9d68-44ce51a7d15b admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.640274 Sep 19 12:19:09.860664 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 12/25] 10.222.0.93 () {64 vars in 1283 bytes} [Mon Sep 19 12:19:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:19:09.873158 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-9a1cb927-ad0e-409d-934d-def9c2f8cdc6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:10.884759 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-9a1cb927-ad0e-409d-934d-def9c2f8cdc6 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 1.015238 Sep 19 12:19:10.886178 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 14/26] 10.222.0.93 () {64 vars in 1333 bytes} [Mon Sep 19 12:19:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:13.583863 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-77d0e2c5-defd-46e2-9d68-44ce51a7d15b admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:13.595267 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-77d0e2c5-defd-46e2-9d68-44ce51a7d15b admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 19 12:19:13.595267 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 13/27] 10.222.0.93 () {54 vars in 931 bytes} [Mon Sep 19 12:19:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:19:14.083929 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-6a19bd4b-5bbb-48b9-bdf5-e67cd63fdb51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "name": "m1.medium", "disk": 40, "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:14.166574 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-6a19bd4b-5bbb-48b9-bdf5-e67cd63fdb51 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.573969 Sep 19 12:19:14.167143 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 15/28] 10.222.0.93 () {64 vars in 1283 bytes} [Mon Sep 19 12:19:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:19:14.181903 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-3b0e64b8-abc3-49bd-b28d-d3d064364af5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:14.341440 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-3b0e64b8-abc3-49bd-b28d-d3d064364af5 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.165540 Sep 19 12:19:14.344823 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 14/29] 10.222.0.93 () {64 vars in 1333 bytes} [Mon Sep 19 12:19:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:17.008468 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-6a19bd4b-5bbb-48b9-bdf5-e67cd63fdb51 admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:17.009624 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-6a19bd4b-5bbb-48b9-bdf5-e67cd63fdb51 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Sep 19 12:19:17.010111 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 16/30] 10.222.0.93 () {54 vars in 931 bytes} [Mon Sep 19 12:19:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:19:17.472419 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-b8dc556f-8e4d-4209-a94c-db1842f40a59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "name": "m1.large", "disk": 80}} {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:17.563145 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-b8dc556f-8e4d-4209-a94c-db1842f40a59 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.546591 Sep 19 12:19:17.563594 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 15/31] 10.222.0.93 () {64 vars in 1283 bytes} [Mon Sep 19 12:19:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:19:17.576368 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-6e12a57b-0594-4369-8e3b-f0f3ef6f6fa7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:17.581473 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG dbcounter [-] [106187] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:17.701799 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-6e12a57b-0594-4369-8e3b-f0f3ef6f6fa7 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129583 Sep 19 12:19:17.702679 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 17/32] 10.222.0.93 () {64 vars in 1333 bytes} [Mon Sep 19 12:19:17 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:19:20.344179 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-b8dc556f-8e4d-4209-a94c-db1842f40a59 admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:20.348823 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-b8dc556f-8e4d-4209-a94c-db1842f40a59 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Sep 19 12:19:20.348823 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 16/33] 10.222.0.93 () {54 vars in 931 bytes} [Mon Sep 19 12:19:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:19:20.900540 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-d4ab8d1c-e32a-4286-94ec-fa37fa038dde admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true, "swap": 0, "ram": 16384, "disk": 160, "id": "5"}} {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:22.149515 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-d4ab8d1c-e32a-4286-94ec-fa37fa038dde admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 1.797335 Sep 19 12:19:22.150272 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 18/34] 10.222.0.93 () {64 vars in 1283 bytes} [Mon Sep 19 12:19:20 2022] POST /compute/v2.1/flavors => generated 408 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:19:22.162739 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-6c185732-209b-466a-a784-02119a8075be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:22.256281 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-6c185732-209b-466a-a784-02119a8075be admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097209 Sep 19 12:19:22.256972 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 17/35] 10.222.0.93 () {64 vars in 1333 bytes} [Mon Sep 19 12:19:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:36.307310 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-d4ab8d1c-e32a-4286-94ec-fa37fa038dde admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:36.308232 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-d4ab8d1c-e32a-4286-94ec-fa37fa038dde admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 19 12:19:36.308653 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 19/36] 10.222.0.93 () {54 vars in 931 bytes} [Mon Sep 19 12:19:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:19:36.319473 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG dbcounter [-] [106186] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=106186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:36.713335 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-1d2e2042-9700-4173-9147-68e8ff221fc4 admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:36.732382 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-1d2e2042-9700-4173-9147-68e8ff221fc4 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.417390 Sep 19 12:19:36.732959 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 18/37] 10.222.0.93 () {60 vars in 1292 bytes} [Mon Sep 19 12:19:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:38.176496 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-d4ab8d1c-e32a-4286-94ec-fa37fa038dde admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:38.177526 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-d4ab8d1c-e32a-4286-94ec-fa37fa038dde admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 19 12:19:38.177922 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 20/38] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Sep 19 12:19:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:19:38.734236 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-29672732-add7-43e7-ade5-6a0c287d868e admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:38.739691 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.wsgi [None req-29672732-add7-43e7-ade5-6a0c287d868e admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-29672732-add7-43e7-ade5-6a0c287d868e admin admin] Request method failure captured: Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Accept: application/json Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Accept-Encoding: gzip, deflate Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Connection: keep-alive Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Content-Length: 0 Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Host: 10.222.0.93 Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Openstack-Api-Version: compute 2.92 Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Openstack-System-Scope: None Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: User-Agent: python-novaclient Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Auth-Token: gAAAAABjKF5aFj_Icr-cISr7T24x_jtbi4YbxibxVnsVEdxidFGn6xLOsvkfvLLcxTVqWN6AGnU_IvHdTv2zTV2qMfAGu4suWDWn_GQ6NzcU2t3KovwIuM31aEd7X4PthGlTqimVTfWSetyOLEanyIyvCpTqTuoqPyRlIh7gCK6Lrm2SYU8ufYg Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Domain-Id: None Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Domain-Name: None Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Identity-Status: Confirmed Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Is-Admin-Project: True Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Project-Domain-Id: default Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Project-Domain-Name: Default Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Project-Id: 925961f4c2dc4b8cba8e24f997148b4c Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Project-Name: admin Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Role: admin,reader,member Sep 19 12:19:38.742929 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Roles: admin,reader,member Sep 19 12:19:38.744524 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/925961f4c2dc4b8cba8e24f997148b4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_925961f4c2dc4b8cba8e24f997148b4c", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/925961f4c2dc4b8cba8e24f997148b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/925961f4c2dc4b8cba8e24f997148b4c"}]}] Sep 19 12:19:38.744524 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Tenant: admin Sep 19 12:19:38.744524 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Tenant-Id: 925961f4c2dc4b8cba8e24f997148b4c Sep 19 12:19:38.744524 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Tenant-Name: admin Sep 19 12:19:38.744524 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-User: admin Sep 19 12:19:38.744524 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-User-Domain-Id: default Sep 19 12:19:38.744524 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-User-Domain-Name: Default Sep 19 12:19:38.744524 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-User-Id: ab9a80b0167448109e1e9ca98d7ee699 Sep 19 12:19:38.744524 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-User-Name: admin Sep 19 12:19:38.744524 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: method: > Sep 19 12:19:38.744524 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: exception: Flavor 42 could not be found. Sep 19 12:19:38.744524 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: action_args: {'id': '42'} Sep 19 12:19:38.744524 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:19:38.744524 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:19:38.745432 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 12:19:38.745432 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 12:19:38.745432 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 12:19:38.745432 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 12:19:38.745432 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 12:19:38.745432 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 12:19:38.745432 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 12:19:38.745432 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 12:19:38.745432 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 12:19:38.745432 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:19:38.745432 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 12:19:38.745432 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 12:19:38.745432 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 19 12:19:38.745432 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Sep 19 12:19:38.745432 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:19:38.745432 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Sep 19 12:19:38.745432 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:19:38.745432 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:19:38.745432 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:19:38.746643 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:19:38.746643 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:19:38.746643 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:19:38.746643 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:19:38.746643 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 12:19:38.746643 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:19:38.746643 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 19 12:19:38.746643 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Sep 19 12:19:38.746643 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:19:38.746643 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Sep 19 12:19:38.746643 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:19:38.746643 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:19:38.746643 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:19:38.746643 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:19:38.746643 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:19:38.746643 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 19 12:19:38.746643 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Sep 19 12:19:38.746643 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-29672732-add7-43e7-ade5-6a0c287d868e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:19:38.747752 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-29672732-add7-43e7-ade5-6a0c287d868e admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.405715 Sep 19 12:19:38.747752 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 19/39] 10.222.0.93 () {60 vars in 1190 bytes} [Mon Sep 19 12:19:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 12:19:38.754449 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-273e5965-e95c-41e2-ad69-b2622339b02c admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:38.759405 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG dbcounter [-] [106187] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:38.779094 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-273e5965-e95c-41e2-ad69-b2622339b02c admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028255 Sep 19 12:19:38.782554 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 21/40] 10.222.0.93 () {60 vars in 1210 bytes} [Mon Sep 19 12:19:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:38.790843 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-21a12db8-28df-4de0-b44b-93338dd46bb3 admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:38.812913 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-21a12db8-28df-4de0-b44b-93338dd46bb3 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026633 Sep 19 12:19:38.813469 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 20/41] 10.222.0.93 () {60 vars in 1210 bytes} [Mon Sep 19 12:19:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:38.823223 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-95948e26-2926-461c-a9a5-0c20268fac82 admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:38.828766 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.wsgi [None req-95948e26-2926-461c-a9a5-0c20268fac82 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-95948e26-2926-461c-a9a5-0c20268fac82 admin admin] Request method failure captured: Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Accept: application/json Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Accept-Encoding: gzip, deflate Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Connection: keep-alive Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Content-Length: 0 Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Host: 10.222.0.93 Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Openstack-Api-Version: compute 2.92 Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Openstack-System-Scope: None Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: User-Agent: python-novaclient Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Auth-Token: gAAAAABjKF5aFj_Icr-cISr7T24x_jtbi4YbxibxVnsVEdxidFGn6xLOsvkfvLLcxTVqWN6AGnU_IvHdTv2zTV2qMfAGu4suWDWn_GQ6NzcU2t3KovwIuM31aEd7X4PthGlTqimVTfWSetyOLEanyIyvCpTqTuoqPyRlIh7gCK6Lrm2SYU8ufYg Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Domain-Id: None Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Domain-Name: None Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Identity-Status: Confirmed Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Is-Admin-Project: True Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Project-Domain-Id: default Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Project-Domain-Name: Default Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Project-Id: 925961f4c2dc4b8cba8e24f997148b4c Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Project-Name: admin Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Role: admin,reader,member Sep 19 12:19:38.832078 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Roles: admin,reader,member Sep 19 12:19:38.833636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/925961f4c2dc4b8cba8e24f997148b4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_925961f4c2dc4b8cba8e24f997148b4c", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/925961f4c2dc4b8cba8e24f997148b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/925961f4c2dc4b8cba8e24f997148b4c"}]}] Sep 19 12:19:38.833636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Tenant: admin Sep 19 12:19:38.833636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Tenant-Id: 925961f4c2dc4b8cba8e24f997148b4c Sep 19 12:19:38.833636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Tenant-Name: admin Sep 19 12:19:38.833636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-User: admin Sep 19 12:19:38.833636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-User-Domain-Id: default Sep 19 12:19:38.833636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-User-Domain-Name: Default Sep 19 12:19:38.833636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-User-Id: ab9a80b0167448109e1e9ca98d7ee699 Sep 19 12:19:38.833636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-User-Name: admin Sep 19 12:19:38.833636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: method: > Sep 19 12:19:38.833636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: exception: Flavor 42 could not be found. Sep 19 12:19:38.833636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: action_args: {'id': '42'} Sep 19 12:19:38.833636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:19:38.833636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:19:38.834636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 12:19:38.834636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 12:19:38.834636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 12:19:38.834636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 12:19:38.834636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 12:19:38.834636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 12:19:38.834636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 12:19:38.834636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 12:19:38.834636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 12:19:38.834636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:19:38.834636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 12:19:38.834636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 12:19:38.834636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 19 12:19:38.834636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Sep 19 12:19:38.834636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:19:38.834636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Sep 19 12:19:38.834636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:19:38.834636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:19:38.834636 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:19:38.836516 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:19:38.836516 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:19:38.836516 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:19:38.836516 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:19:38.836516 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 12:19:38.836516 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:19:38.836516 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 19 12:19:38.836516 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Sep 19 12:19:38.836516 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:19:38.836516 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Sep 19 12:19:38.836516 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:19:38.836516 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:19:38.836516 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:19:38.836516 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:19:38.836516 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:19:38.836516 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 19 12:19:38.836516 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Sep 19 12:19:38.836516 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-95948e26-2926-461c-a9a5-0c20268fac82 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:19:38.842357 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-95948e26-2926-461c-a9a5-0c20268fac82 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014194 Sep 19 12:19:38.842357 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 22/42] 10.222.0.93 () {60 vars in 1190 bytes} [Mon Sep 19 12:19:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 12:19:40.063854 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-21a12db8-28df-4de0-b44b-93338dd46bb3 admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:40.064895 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-21a12db8-28df-4de0-b44b-93338dd46bb3 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 19 12:19:40.065325 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 21/43] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Sep 19 12:19:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:19:40.587613 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-c13acf3d-7d24-4180-a7c6-e9fe251566ba admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:40.593314 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.wsgi [None req-c13acf3d-7d24-4180-a7c6-e9fe251566ba admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-c13acf3d-7d24-4180-a7c6-e9fe251566ba admin admin] Request method failure captured: Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Accept: application/json Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Accept-Encoding: gzip, deflate Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Connection: keep-alive Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Content-Length: 0 Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Host: 10.222.0.93 Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Openstack-Api-Version: compute 2.92 Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Openstack-System-Scope: None Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: User-Agent: python-novaclient Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Auth-Token: gAAAAABjKF5bfFWmK4bGyiY9AJaVHDZ0cLv02yDHArSHx5Zk-yX7lHUoLAAIqnALECS1XoeZlBl2ImTEEl_d6sxlK9jb85ZS-PbZBJ6LHW29up2gkHH7tqI2gPVom7I6b5wd6flAVQseoy7rdKGpIV4fW5a_nS-7U-1ks_reaA15r2O6mWiLQqw Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Domain-Id: None Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Domain-Name: None Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Identity-Status: Confirmed Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Is-Admin-Project: True Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Project-Domain-Id: default Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Project-Domain-Name: Default Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Project-Id: 925961f4c2dc4b8cba8e24f997148b4c Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Project-Name: admin Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Role: admin,reader,member Sep 19 12:19:40.594812 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Roles: admin,reader,member Sep 19 12:19:40.596408 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/925961f4c2dc4b8cba8e24f997148b4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_925961f4c2dc4b8cba8e24f997148b4c", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/925961f4c2dc4b8cba8e24f997148b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/925961f4c2dc4b8cba8e24f997148b4c"}]}] Sep 19 12:19:40.596408 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Tenant: admin Sep 19 12:19:40.596408 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Tenant-Id: 925961f4c2dc4b8cba8e24f997148b4c Sep 19 12:19:40.596408 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Tenant-Name: admin Sep 19 12:19:40.596408 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-User: admin Sep 19 12:19:40.596408 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-User-Domain-Id: default Sep 19 12:19:40.596408 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-User-Domain-Name: Default Sep 19 12:19:40.596408 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-User-Id: ab9a80b0167448109e1e9ca98d7ee699 Sep 19 12:19:40.596408 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-User-Name: admin Sep 19 12:19:40.596408 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: method: > Sep 19 12:19:40.596408 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: exception: Flavor 84 could not be found. Sep 19 12:19:40.596408 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: action_args: {'id': '84'} Sep 19 12:19:40.596408 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:19:40.596408 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:19:40.597322 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 12:19:40.597322 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 12:19:40.597322 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 12:19:40.597322 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 12:19:40.597322 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 12:19:40.597322 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 12:19:40.597322 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 12:19:40.597322 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 12:19:40.597322 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 12:19:40.597322 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:19:40.597322 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 12:19:40.597322 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 12:19:40.597322 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 19 12:19:40.597322 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Sep 19 12:19:40.597322 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:19:40.597322 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Sep 19 12:19:40.597322 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:19:40.597322 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:19:40.597322 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:19:40.598391 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:19:40.598391 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:19:40.598391 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:19:40.598391 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:19:40.598391 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 12:19:40.598391 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:19:40.598391 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 19 12:19:40.598391 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Sep 19 12:19:40.598391 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:19:40.598391 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Sep 19 12:19:40.598391 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:19:40.598391 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:19:40.598391 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:19:40.598391 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:19:40.598391 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:19:40.598391 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 19 12:19:40.598391 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Sep 19 12:19:40.598391 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-c13acf3d-7d24-4180-a7c6-e9fe251566ba admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:19:40.599412 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-c13acf3d-7d24-4180-a7c6-e9fe251566ba admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.394344 Sep 19 12:19:40.599412 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 23/44] 10.222.0.93 () {60 vars in 1190 bytes} [Mon Sep 19 12:19:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 12:19:40.605961 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-0a39fa6f-7c2c-4dca-a0bf-12cd3e6540d7 admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:40.620422 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-0a39fa6f-7c2c-4dca-a0bf-12cd3e6540d7 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018053 Sep 19 12:19:40.620982 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 22/45] 10.222.0.93 () {60 vars in 1210 bytes} [Mon Sep 19 12:19:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:40.630390 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-42f6ed5b-ff7c-4c84-bbde-53d17a45d2c8 admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:40.646219 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-42f6ed5b-ff7c-4c84-bbde-53d17a45d2c8 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019439 Sep 19 12:19:40.646760 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 24/46] 10.222.0.93 () {60 vars in 1210 bytes} [Mon Sep 19 12:19:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:40.656915 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-cd978773-e4e9-4316-9bfe-350efb0abb89 admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:40.661947 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.wsgi [None req-cd978773-e4e9-4316-9bfe-350efb0abb89 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-cd978773-e4e9-4316-9bfe-350efb0abb89 admin admin] Request method failure captured: Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Accept: application/json Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Accept-Encoding: gzip, deflate Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Connection: keep-alive Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Content-Length: 0 Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Host: 10.222.0.93 Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Openstack-Api-Version: compute 2.92 Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Openstack-System-Scope: None Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: User-Agent: python-novaclient Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Auth-Token: gAAAAABjKF5bfFWmK4bGyiY9AJaVHDZ0cLv02yDHArSHx5Zk-yX7lHUoLAAIqnALECS1XoeZlBl2ImTEEl_d6sxlK9jb85ZS-PbZBJ6LHW29up2gkHH7tqI2gPVom7I6b5wd6flAVQseoy7rdKGpIV4fW5a_nS-7U-1ks_reaA15r2O6mWiLQqw Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Domain-Id: None Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Domain-Name: None Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Identity-Status: Confirmed Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Is-Admin-Project: True Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Project-Domain-Id: default Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Project-Domain-Name: Default Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Project-Id: 925961f4c2dc4b8cba8e24f997148b4c Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Project-Name: admin Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Role: admin,reader,member Sep 19 12:19:40.663446 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Roles: admin,reader,member Sep 19 12:19:40.664967 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/925961f4c2dc4b8cba8e24f997148b4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_925961f4c2dc4b8cba8e24f997148b4c", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/925961f4c2dc4b8cba8e24f997148b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/925961f4c2dc4b8cba8e24f997148b4c"}]}] Sep 19 12:19:40.664967 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Tenant: admin Sep 19 12:19:40.664967 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Tenant-Id: 925961f4c2dc4b8cba8e24f997148b4c Sep 19 12:19:40.664967 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Tenant-Name: admin Sep 19 12:19:40.664967 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-User: admin Sep 19 12:19:40.664967 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-User-Domain-Id: default Sep 19 12:19:40.664967 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-User-Domain-Name: Default Sep 19 12:19:40.664967 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-User-Id: ab9a80b0167448109e1e9ca98d7ee699 Sep 19 12:19:40.664967 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-User-Name: admin Sep 19 12:19:40.664967 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: method: > Sep 19 12:19:40.664967 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: exception: Flavor 84 could not be found. Sep 19 12:19:40.664967 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: action_args: {'id': '84'} Sep 19 12:19:40.664967 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:19:40.664967 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:19:40.665856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 12:19:40.665856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 12:19:40.665856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 12:19:40.665856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 12:19:40.665856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 12:19:40.665856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 12:19:40.665856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 12:19:40.665856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 12:19:40.665856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 12:19:40.665856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:19:40.665856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 12:19:40.665856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 12:19:40.665856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 19 12:19:40.665856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Sep 19 12:19:40.665856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:19:40.665856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Sep 19 12:19:40.665856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:19:40.665856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:19:40.665856 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:19:40.667028 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:19:40.667028 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:19:40.667028 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:19:40.667028 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:19:40.667028 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 12:19:40.667028 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:19:40.667028 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 19 12:19:40.667028 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Sep 19 12:19:40.667028 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:19:40.667028 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Sep 19 12:19:40.667028 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:19:40.667028 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:19:40.667028 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:19:40.667028 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:19:40.667028 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:19:40.667028 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 19 12:19:40.667028 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Sep 19 12:19:40.667028 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-cd978773-e4e9-4316-9bfe-350efb0abb89 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:19:40.668020 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-cd978773-e4e9-4316-9bfe-350efb0abb89 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012030 Sep 19 12:19:40.668020 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 23/47] 10.222.0.93 () {60 vars in 1190 bytes} [Mon Sep 19 12:19:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 12:19:41.882530 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-42f6ed5b-ff7c-4c84-bbde-53d17a45d2c8 admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:41.883594 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-42f6ed5b-ff7c-4c84-bbde-53d17a45d2c8 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001770 Sep 19 12:19:41.883992 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 25/48] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Sep 19 12:19:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:19:42.408888 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-86b16490-b6ed-4276-aaa2-5b90e38e1e88 admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:42.415067 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.wsgi [None req-86b16490-b6ed-4276-aaa2-5b90e38e1e88 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-86b16490-b6ed-4276-aaa2-5b90e38e1e88 admin admin] Request method failure captured: Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Accept: application/json Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Accept-Encoding: gzip, deflate Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Connection: keep-alive Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Content-Length: 0 Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Host: 10.222.0.93 Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Openstack-Api-Version: compute 2.92 Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Openstack-System-Scope: None Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: User-Agent: python-novaclient Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Auth-Token: gAAAAABjKF5dyxLss2PfHC-icvKiXpRCTpNnxJgoAyW_b-uP8ncOE6t7gf2PT9ii04NDdO1dj8SnGXhpK_WpiqyebNBhwgHV8JINAMWNkDdp1ycvYnqiUcnTS5VUMYgBbNvTLw8aqHRk3NisEsiaVbtIypOqelwnCCRPpxKyo-S9-Thvuljswco Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Domain-Id: None Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Domain-Name: None Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Identity-Status: Confirmed Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Is-Admin-Project: True Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Project-Domain-Id: default Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Project-Domain-Name: Default Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Project-Id: 925961f4c2dc4b8cba8e24f997148b4c Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Project-Name: admin Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Role: admin,reader,member Sep 19 12:19:42.416544 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Roles: admin,reader,member Sep 19 12:19:42.418030 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/925961f4c2dc4b8cba8e24f997148b4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_925961f4c2dc4b8cba8e24f997148b4c", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/925961f4c2dc4b8cba8e24f997148b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/925961f4c2dc4b8cba8e24f997148b4c"}]}] Sep 19 12:19:42.418030 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Tenant: admin Sep 19 12:19:42.418030 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Tenant-Id: 925961f4c2dc4b8cba8e24f997148b4c Sep 19 12:19:42.418030 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-Tenant-Name: admin Sep 19 12:19:42.418030 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-User: admin Sep 19 12:19:42.418030 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-User-Domain-Id: default Sep 19 12:19:42.418030 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-User-Domain-Name: Default Sep 19 12:19:42.418030 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-User-Id: ab9a80b0167448109e1e9ca98d7ee699 Sep 19 12:19:42.418030 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: X-User-Name: admin Sep 19 12:19:42.418030 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: method: > Sep 19 12:19:42.418030 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: exception: Flavor 451 could not be found. Sep 19 12:19:42.418030 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: action_args: {'id': '451'} Sep 19 12:19:42.418030 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:19:42.418030 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:19:42.419515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 12:19:42.419515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 12:19:42.419515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 12:19:42.419515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 12:19:42.419515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 12:19:42.419515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 12:19:42.419515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 12:19:42.419515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 12:19:42.419515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 12:19:42.419515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:19:42.419515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 12:19:42.419515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 12:19:42.419515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 19 12:19:42.419515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Sep 19 12:19:42.419515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:19:42.419515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Sep 19 12:19:42.419515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:19:42.419515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:19:42.419515 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:19:42.420877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:19:42.420877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:19:42.420877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:19:42.420877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:19:42.420877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 12:19:42.420877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:19:42.420877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 19 12:19:42.420877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Sep 19 12:19:42.420877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:19:42.420877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Sep 19 12:19:42.420877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:19:42.420877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:19:42.420877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:19:42.420877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:19:42.420877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:19:42.420877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 19 12:19:42.420877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: ERROR nova.api.openstack.wsgi Sep 19 12:19:42.420877 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-86b16490-b6ed-4276-aaa2-5b90e38e1e88 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:19:42.422101 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-86b16490-b6ed-4276-aaa2-5b90e38e1e88 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.397276 Sep 19 12:19:42.422101 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 24/49] 10.222.0.93 () {60 vars in 1193 bytes} [Mon Sep 19 12:19:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 12:19:42.428448 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-c533a92a-5e08-4a1a-a5b3-2bc4e9996b06 admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:42.444241 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-c533a92a-5e08-4a1a-a5b3-2bc4e9996b06 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019522 Sep 19 12:19:42.444830 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 26/50] 10.222.0.93 () {60 vars in 1210 bytes} [Mon Sep 19 12:19:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:42.454621 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-ad6693f2-5719-4709-90ed-78b132a48b5f admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:42.469988 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-ad6693f2-5719-4709-90ed-78b132a48b5f admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018934 Sep 19 12:19:42.470532 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 25/51] 10.222.0.93 () {60 vars in 1210 bytes} [Mon Sep 19 12:19:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:42.479960 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-d38b7945-a23a-45b4-9f3e-db785c9c59e4 admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:42.485847 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.wsgi [None req-d38b7945-a23a-45b4-9f3e-db785c9c59e4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-d38b7945-a23a-45b4-9f3e-db785c9c59e4 admin admin] Request method failure captured: Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Accept: application/json Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Accept-Encoding: gzip, deflate Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Connection: keep-alive Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Content-Length: 0 Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Host: 10.222.0.93 Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Openstack-Api-Version: compute 2.92 Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Openstack-System-Scope: None Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: User-Agent: python-novaclient Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Auth-Token: gAAAAABjKF5dyxLss2PfHC-icvKiXpRCTpNnxJgoAyW_b-uP8ncOE6t7gf2PT9ii04NDdO1dj8SnGXhpK_WpiqyebNBhwgHV8JINAMWNkDdp1ycvYnqiUcnTS5VUMYgBbNvTLw8aqHRk3NisEsiaVbtIypOqelwnCCRPpxKyo-S9-Thvuljswco Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Domain-Id: None Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Domain-Name: None Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Identity-Status: Confirmed Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Is-Admin-Project: True Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Project-Domain-Id: default Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Project-Domain-Name: Default Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Project-Id: 925961f4c2dc4b8cba8e24f997148b4c Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Project-Name: admin Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Role: admin,reader,member Sep 19 12:19:42.487356 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Roles: admin,reader,member Sep 19 12:19:42.488897 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/925961f4c2dc4b8cba8e24f997148b4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_925961f4c2dc4b8cba8e24f997148b4c", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/925961f4c2dc4b8cba8e24f997148b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/925961f4c2dc4b8cba8e24f997148b4c"}]}] Sep 19 12:19:42.488897 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Tenant: admin Sep 19 12:19:42.488897 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Tenant-Id: 925961f4c2dc4b8cba8e24f997148b4c Sep 19 12:19:42.488897 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-Tenant-Name: admin Sep 19 12:19:42.488897 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-User: admin Sep 19 12:19:42.488897 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-User-Domain-Id: default Sep 19 12:19:42.488897 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-User-Domain-Name: Default Sep 19 12:19:42.488897 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-User-Id: ab9a80b0167448109e1e9ca98d7ee699 Sep 19 12:19:42.488897 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: X-User-Name: admin Sep 19 12:19:42.488897 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: method: > Sep 19 12:19:42.488897 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: exception: Flavor 451 could not be found. Sep 19 12:19:42.488897 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: action_args: {'id': '451'} Sep 19 12:19:42.488897 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:19:42.488897 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:19:42.489798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 12:19:42.489798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 12:19:42.489798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 12:19:42.489798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 12:19:42.489798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 12:19:42.489798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 12:19:42.489798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 12:19:42.489798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 12:19:42.489798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 12:19:42.489798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:19:42.489798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 12:19:42.489798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 12:19:42.489798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 19 12:19:42.489798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Sep 19 12:19:42.489798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:19:42.489798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Sep 19 12:19:42.489798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:19:42.489798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:19:42.489798 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:19:42.490904 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:19:42.490904 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:19:42.490904 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:19:42.490904 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:19:42.490904 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 12:19:42.490904 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:19:42.490904 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 19 12:19:42.490904 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Sep 19 12:19:42.490904 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:19:42.490904 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Sep 19 12:19:42.490904 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:19:42.490904 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:19:42.490904 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:19:42.490904 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:19:42.490904 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:19:42.490904 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 19 12:19:42.490904 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: ERROR nova.api.openstack.wsgi Sep 19 12:19:42.490904 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-d38b7945-a23a-45b4-9f3e-db785c9c59e4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:19:42.492309 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-d38b7945-a23a-45b4-9f3e-db785c9c59e4 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012327 Sep 19 12:19:42.492309 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 27/52] 10.222.0.93 () {60 vars in 1193 bytes} [Mon Sep 19 12:19:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 12:19:43.702853 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-ad6693f2-5719-4709-90ed-78b132a48b5f admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:43.703860 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-ad6693f2-5719-4709-90ed-78b132a48b5f admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 19 12:19:43.704259 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 26/53] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Sep 19 12:19:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:19:44.226319 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-8b3b90e6-1e0e-4aa5-b377-e9b40798d999 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:44.326621 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-8b3b90e6-1e0e-4aa5-b377-e9b40798d999 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.483192 Sep 19 12:19:44.327171 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 28/54] 10.222.0.93 () {64 vars in 1235 bytes} [Mon Sep 19 12:19:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:19:45.546927 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-ad6693f2-5719-4709-90ed-78b132a48b5f admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:45.547963 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-ad6693f2-5719-4709-90ed-78b132a48b5f admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 19 12:19:45.548367 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 27/55] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Sep 19 12:19:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:19:46.075796 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-fc09f81f-698b-4912-a74b-83f2dab7b329 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:46.177690 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-fc09f81f-698b-4912-a74b-83f2dab7b329 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.489219 Sep 19 12:19:46.178258 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 29/56] 10.222.0.93 () {64 vars in 1235 bytes} [Mon Sep 19 12:19:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:19:47.401913 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-ad6693f2-5719-4709-90ed-78b132a48b5f admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:47.402899 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-ad6693f2-5719-4709-90ed-78b132a48b5f admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 19 12:19:47.403305 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 28/57] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Sep 19 12:19:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:19:47.930609 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-43ed87cf-a25c-426d-9870-99ef0cc24c91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:48.048347 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-43ed87cf-a25c-426d-9870-99ef0cc24c91 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.504710 Sep 19 12:19:48.048841 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 30/58] 10.222.0.93 () {64 vars in 1235 bytes} [Mon Sep 19 12:19:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:19:49.269721 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-ad6693f2-5719-4709-90ed-78b132a48b5f admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:49.270815 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-ad6693f2-5719-4709-90ed-78b132a48b5f admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 19 12:19:49.271224 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 29/59] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Sep 19 12:19:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:19:49.805063 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-8be4f695-6916-4ff3-9019-a12163bc8801 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:49.880076 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-8be4f695-6916-4ff3-9019-a12163bc8801 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.469202 Sep 19 12:19:49.880629 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 31/60] 10.222.0.93 () {64 vars in 1235 bytes} [Mon Sep 19 12:19:49 2022] POST /compute/v2.1/flavors => generated 409 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:19:51.112908 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-ad6693f2-5719-4709-90ed-78b132a48b5f admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:51.113939 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-ad6693f2-5719-4709-90ed-78b132a48b5f admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Sep 19 12:19:51.114345 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 30/61] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Sep 19 12:19:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:19:51.637919 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-a12bed7f-53d9-4d53-9584-0e076a1697aa admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:51.658731 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-a12bed7f-53d9-4d53-9584-0e076a1697aa admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.406169 Sep 19 12:19:51.659278 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 32/62] 10.222.0.93 () {60 vars in 1202 bytes} [Mon Sep 19 12:19:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:20:49.712394 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-ad6693f2-5719-4709-90ed-78b132a48b5f admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:49.714121 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-ad6693f2-5719-4709-90ed-78b132a48b5f admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 19 12:20:49.714535 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 31/63] 10.222.0.93 () {54 vars in 931 bytes} [Mon Sep 19 12:20:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:20:49.725378 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG dbcounter [-] [106187] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:50.110938 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-018ded6b-ebda-4baf-aa66-08c980cb2bba admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:50.131022 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-018ded6b-ebda-4baf-aa66-08c980cb2bba admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.410234 Sep 19 12:20:50.131556 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 33/64] 10.222.0.93 () {60 vars in 1292 bytes} [Mon Sep 19 12:20:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:20:50.152792 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG dbcounter [-] [106186] Writing DB stats nova_api:SELECT=14 {{(pid=106186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:50.156547 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-1926dbbf-23ec-400d-8ff1-233d5886127a admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:50.163735 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-1926dbbf-23ec-400d-8ff1-233d5886127a admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012918 Sep 19 12:20:50.165770 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 32/65] 10.222.0.93 () {60 vars in 1283 bytes} [Mon Sep 19 12:20:50 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:50.177428 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-628963e0-f86d-442c-b2a5-9ec4dab28bf7 admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:50.185231 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-628963e0-f86d-442c-b2a5-9ec4dab28bf7 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011676 Sep 19 12:20:50.185797 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 34/66] 10.222.0.93 () {60 vars in 1286 bytes} [Mon Sep 19 12:20:50 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:50.197880 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-35e36918-afc7-4c59-ab0d-aa7681eceadc admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:50.205863 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-35e36918-afc7-4c59-ab0d-aa7681eceadc admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011722 Sep 19 12:20:50.206404 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 33/67] 10.222.0.93 () {60 vars in 1286 bytes} [Mon Sep 19 12:20:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:50.218639 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-f9cb40b0-2237-4f61-9116-4e5c539df8ff admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:50.225970 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-f9cb40b0-2237-4f61-9116-4e5c539df8ff admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010934 Sep 19 12:20:50.226486 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 35/68] 10.222.0.93 () {60 vars in 1283 bytes} [Mon Sep 19 12:20:50 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:08.691607 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-35e36918-afc7-4c59-ab0d-aa7681eceadc admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:08.692630 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-35e36918-afc7-4c59-ab0d-aa7681eceadc admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 19 12:24:08.693022 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 34/69] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Sep 19 12:24:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:24:08.842181 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG dbcounter [-] [106187] Writing DB stats nova_api:SELECT=6 {{(pid=106187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:24:08.984220 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-e644491f-1a25-4ed7-a4ec-40208d781d4e admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:08.988968 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-e644491f-1a25-4ed7-a4ec-40208d781d4e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:08.989438 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-e644491f-1a25-4ed7-a4ec-40208d781d4e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:08.989864 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-e644491f-1a25-4ed7-a4ec-40208d781d4e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:08.990569 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-e644491f-1a25-4ed7-a4ec-40208d781d4e admin admin] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:08.991000 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-e644491f-1a25-4ed7-a4ec-40208d781d4e admin admin] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:08.991407 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-e644491f-1a25-4ed7-a4ec-40208d781d4e admin admin] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:09.023048 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-e644491f-1a25-4ed7-a4ec-40208d781d4e admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.181938 Sep 19 12:24:09.023527 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 36/70] 10.222.0.93 () {60 vars in 1193 bytes} [Mon Sep 19 12:24:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:24:10.111143 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-35e36918-afc7-4c59-ab0d-aa7681eceadc admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:10.112137 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-35e36918-afc7-4c59-ab0d-aa7681eceadc admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Sep 19 12:24:10.112687 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 35/71] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Sep 19 12:24:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:24:10.302109 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-671b07da-b25a-4dab-90cf-d9ae293adf10 admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:10.306018 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-671b07da-b25a-4dab-90cf-d9ae293adf10 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:10.306491 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-671b07da-b25a-4dab-90cf-d9ae293adf10 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:10.306922 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-671b07da-b25a-4dab-90cf-d9ae293adf10 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:10.307626 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-671b07da-b25a-4dab-90cf-d9ae293adf10 admin admin] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:10.308067 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-671b07da-b25a-4dab-90cf-d9ae293adf10 admin admin] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:10.308481 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-671b07da-b25a-4dab-90cf-d9ae293adf10 admin admin] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:10.327999 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-671b07da-b25a-4dab-90cf-d9ae293adf10 admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077791 Sep 19 12:24:10.328551 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 37/72] 10.222.0.93 () {60 vars in 1193 bytes} [Mon Sep 19 12:24:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:24:21.863008 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-35e36918-afc7-4c59-ab0d-aa7681eceadc admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:21.864017 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-35e36918-afc7-4c59-ab0d-aa7681eceadc admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 19 12:24:21.864415 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 36/73] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Sep 19 12:24:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:24:22.010240 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG dbcounter [-] [106187] Writing DB stats nova_cell0:SELECT=4 {{(pid=106187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:24:22.010986 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG dbcounter [-] [106187] Writing DB stats nova_cell1:SELECT=4 {{(pid=106187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:24:22.011751 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG dbcounter [-] [106187] Writing DB stats nova_api:SELECT=8 {{(pid=106187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:24:22.061075 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-c304bba4-8ee7-4f98-9e2e-464f2c9f60f8 admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:22.064492 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-c304bba4-8ee7-4f98-9e2e-464f2c9f60f8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:22.065008 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-c304bba4-8ee7-4f98-9e2e-464f2c9f60f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:22.065467 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-c304bba4-8ee7-4f98-9e2e-464f2c9f60f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:22.066245 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-c304bba4-8ee7-4f98-9e2e-464f2c9f60f8 admin admin] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:22.066631 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-c304bba4-8ee7-4f98-9e2e-464f2c9f60f8 admin admin] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:22.067075 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-c304bba4-8ee7-4f98-9e2e-464f2c9f60f8 admin admin] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:22.093293 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-c304bba4-8ee7-4f98-9e2e-464f2c9f60f8 admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.087876 Sep 19 12:24:22.093921 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 38/74] 10.222.0.93 () {60 vars in 1193 bytes} [Mon Sep 19 12:24:22 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:24:23.206291 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG nova.api.openstack.wsgi [None req-35e36918-afc7-4c59-ab0d-aa7681eceadc admin admin] Calling method '>' {{(pid=106186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:23.207291 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: INFO nova.api.openstack.requestlog [None req-35e36918-afc7-4c59-ab0d-aa7681eceadc admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 19 12:24:23.207692 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: [pid: 106186|app: 0|req: 37/75] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Sep 19 12:24:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:24:23.405005 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG nova.api.openstack.wsgi [None req-138ba7a6-425b-4ca0-99ed-ccd799e3c915 admin admin] Calling method '>' {{(pid=106187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:23.407165 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-138ba7a6-425b-4ca0-99ed-ccd799e3c915 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:23.407644 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-138ba7a6-425b-4ca0-99ed-ccd799e3c915 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:23.408072 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-138ba7a6-425b-4ca0-99ed-ccd799e3c915 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:23.408861 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-138ba7a6-425b-4ca0-99ed-ccd799e3c915 admin admin] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:23.409313 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-138ba7a6-425b-4ca0-99ed-ccd799e3c915 admin admin] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:23.409724 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: DEBUG oslo_concurrency.lockutils [None req-138ba7a6-425b-4ca0-99ed-ccd799e3c915 admin admin] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:23.432927 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: INFO nova.api.openstack.requestlog [None req-138ba7a6-425b-4ca0-99ed-ccd799e3c915 admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.082494 Sep 19 12:24:23.433515 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: [pid: 106187|app: 0|req: 39/76] 10.222.0.93 () {60 vars in 1193 bytes} [Mon Sep 19 12:24:23 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:25:23.037462 dv-cinder-850618-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 19 12:25:23.038067 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: Mon Sep 19 12:25:23 2022 - graceful shutdown triggered... Sep 19 12:25:23.038508 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: Gracefully killing worker 1 (pid: 106186)... Sep 19 12:25:23.039141 dv-cinder-850618-3-iscsi devstack@n-api.service[106187]: Gracefully killing worker 2 (pid: 106187)... Sep 19 12:25:23.164048 dv-cinder-850618-3-iscsi devstack@n-api.service[106186]: DEBUG dbcounter [-] [106186] Writing DB stats nova_api:SELECT=4 {{(pid=106186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:25:24.038926 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: worker 1 buried after 1 seconds Sep 19 12:25:24.038926 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: worker 2 buried after 1 seconds Sep 19 12:25:24.038926 dv-cinder-850618-3-iscsi devstack@n-api.service[106185]: goodbye to uWSGI. Sep 19 12:25:24.040541 dv-cinder-850618-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 19 12:25:24.041128 dv-cinder-850618-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 19 12:25:24.043826 dv-cinder-850618-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 19 12:25:24.060368 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 19 12:25:24.062429 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 12:25:24 2022] *** Sep 19 12:25:24.062429 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 12:25:24.062429 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 12:25:24.062429 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: nodename: dv-cinder-850618-3-iscsi Sep 19 12:25:24.062429 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: machine: x86_64 Sep 19 12:25:24.062429 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: clock source: unix Sep 19 12:25:24.062429 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: pcre jit disabled Sep 19 12:25:24.062429 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: detected number of CPU cores: 4 Sep 19 12:25:24.062429 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: current working directory: / Sep 19 12:25:24.062429 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: detected binary path: /usr/bin/uwsgi-core Sep 19 12:25:24.062429 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: your processes number limit is 47680 Sep 19 12:25:24.062429 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: your memory page size is 4096 bytes Sep 19 12:25:24.062429 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: detected max file descriptor number: 2048 Sep 19 12:25:24.062429 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: lock engine: pthread robust mutexes Sep 19 12:25:24.063396 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: thunder lock: enabled Sep 19 12:25:24.063396 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 19 12:25:24.063396 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 12:25:24.103194 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: Python main interpreter initialized at 0x55b9239e89c0 Sep 19 12:25:24.103194 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: python threads support enabled Sep 19 12:25:24.103194 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: your server socket listen backlog is limited to 100 connections Sep 19 12:25:24.103194 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: your mercy for graceful operations on workers is 90 seconds Sep 19 12:25:24.103610 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 12:25:24.103610 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: *** Operational MODE: preforking *** Sep 19 12:25:24.103922 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: *** uWSGI is running in multiple interpreter mode *** Sep 19 12:25:24.103922 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: spawned uWSGI master process (pid: 121415) Sep 19 12:25:24.104140 dv-cinder-850618-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 19 12:25:24.106351 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: spawned uWSGI worker 1 (pid: 121428, cores: 1) Sep 19 12:25:24.106351 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: spawned uWSGI worker 2 (pid: 121429, cores: 1) Sep 19 12:25:24.106351 dv-cinder-850618-3-iscsi devstack@n-api.service[121415]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 12:25:24.780380 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 12:25:24.787168 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 12:25:25.958540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 12:25:25.958540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: from cryptography.utils import int_from_bytes Sep 19 12:25:25.959541 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 12:25:25.959541 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: from cryptography.utils import int_from_bytes Sep 19 12:25:25.959541 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 12:25:25.959541 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: from cryptography.utils import int_from_bytes Sep 19 12:25:25.960482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 12:25:25.960482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: from cryptography.utils import int_from_bytes Sep 19 12:25:28.453836 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 12:25:28.454495 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 12:25:28.454592 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 12:25:28.454978 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 12:25:28.455185 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 12:25:28.455580 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.455916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.456245 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.456571 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.456943 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.457274 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.457594 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.457920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.458266 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.458534 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.458860 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.459376 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850618-3-iscsi {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.459712 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.460029 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.460347 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.460723 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.461031 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.461352 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.461677 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.462223 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.463631 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.463631 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.463631 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.464072 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.464293 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.464624 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.464955 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.465264 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.465589 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.465912 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.466324 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850618-3-iscsi {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.466649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.466963 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.467295 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.467731 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.468055 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.468366 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.468855 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.469189 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.469503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.469838 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.470156 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.470481 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.470812 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.471162 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.471564 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.471851 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.472171 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.472412 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.472825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.473085 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.473398 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.473728 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.474053 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.474379 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.474667 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.474908 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.475202 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.475528 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.475838 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.476148 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.476459 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.476798 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.477106 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.477413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.478330 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.478652 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.478978 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.479295 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.479620 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.479928 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.480328 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.480786 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.481045 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.481357 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.481706 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.482029 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.482341 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.482664 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.483059 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.483374 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.483706 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.484014 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.484332 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.484700 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.485018 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.485273 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.485590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.485896 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.486225 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.486539 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.486843 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.487462 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.487939 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.488408 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.488760 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.489079 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.489394 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.489711 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.490025 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.490336 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.490650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.490963 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.491273 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.491599 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.492108 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.492430 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.492771 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.493088 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.493453 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.494329 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.494329 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.494521 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.494707 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.495017 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.495328 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.495497 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 12:25:28.496021 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.496236 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 12:25:28.496976 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.497138 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 12:25:28.497298 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.497298 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.497672 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 12:25:28.497672 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 12:25:28.498102 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.498102 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.498581 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.498840 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.499969 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.500232 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.500478 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.500764 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.501009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.501370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.501611 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.501925 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.502151 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.502383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.502630 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.502869 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.503102 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.503350 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.503580 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.503814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.504092 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.504334 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.504568 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.504839 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.505091 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850618-3-iscsi {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.505324 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.505575 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.505809 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.506052 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.506287 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.506520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.506762 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.507032 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.507273 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.507446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.507604 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.507771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.507938 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.508096 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.508241 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.508241 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.508669 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.508949 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.509365 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.509365 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.510330 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.510496 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.510657 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.510820 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.510976 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.511130 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.511277 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.511505 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.511665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.511900 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.512058 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.512225 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.512372 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.512525 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.512715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.512876 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.513025 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.513170 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850618-3-iscsi {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.513317 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.513476 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.513703 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.513870 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.514026 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.514192 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.514341 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.514562 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.514733 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.514944 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.515161 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.515389 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.515626 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.515863 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.516102 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.516261 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.516417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.516629 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.516830 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.516991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.517178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.517384 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.517593 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.517759 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.517923 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.518325 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.518325 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.518610 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.518756 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.518907 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.519083 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.519310 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.519610 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.520445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.520680 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.520850 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.521065 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.521226 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.521385 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.521543 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.521706 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.521953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.522135 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.522329 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.522556 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.522778 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.523008 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.523008 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.523363 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.523563 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.523792 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.524042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.524293 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.524293 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.524887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.525108 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.525289 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.525476 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.525640 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.525788 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.525961 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.526150 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.526299 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.526299 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.526588 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.526811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.527038 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.527212 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.527437 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.527635 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.527885 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.528094 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.528254 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.528432 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.528637 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.528808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.529038 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.529251 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.529447 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.531164 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.531343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.531343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.531689 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.531689 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.532129 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.532296 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.532664 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.532832 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.533186 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.533506 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.533662 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.533818 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.533980 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.534171 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.534321 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.534494 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.534646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.534824 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.535049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.535236 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.535402 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.535559 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.535753 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.535911 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.536067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.536222 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.536423 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.536660 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.536815 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.536963 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.537131 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.537320 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.537320 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.537684 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.537836 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.537981 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.538134 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.538337 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.538532 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.538712 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.538955 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.539117 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.539272 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.539490 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.539750 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.540170 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.541535 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.541712 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.541883 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.542189 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.542422 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.542614 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.542819 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.542978 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.543126 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.543319 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.544128 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.544285 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.544285 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.544285 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.544285 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.544285 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.544285 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.544285 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.544285 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.545896 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.545896 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.545896 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.545896 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.545896 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.545896 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.545896 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.545896 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.547579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.547756 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.547930 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.548094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.548252 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.548399 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.548552 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.548757 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.548907 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.549077 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.549251 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.549407 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.549568 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.549781 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.550010 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.550431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.550680 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.550911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.552009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.552236 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.552394 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.552571 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.552571 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.552989 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.553230 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.553476 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.553719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.553949 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.554182 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.554427 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.554665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.554913 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.555143 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.555409 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.555650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.555961 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.556736 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.556998 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.557254 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.557519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.557772 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.558037 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.558292 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.558545 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.558810 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.559065 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.559324 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.559631 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.559889 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.560127 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.561105 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.561355 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.561898 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.562048 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.562143 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.562229 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.562514 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.562607 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.562721 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.562826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.562922 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.563028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.563166 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.563304 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.563426 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.563523 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.563610 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.563695 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.563814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.563904 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.564005 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.564093 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.564187 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.564187 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.564187 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.564503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 12:25:28.564661 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.564770 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.564770 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.564960 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.565055 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.565157 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.565157 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.565330 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.565439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.565538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.565634 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.565729 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.565836 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.565925 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.566019 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.566113 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.566113 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.566287 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.566381 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.566490 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.566586 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.566681 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.566777 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.566865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.566979 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.567086 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.567190 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.567285 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.567381 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.567468 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.567552 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.567645 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.567780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.567911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.568015 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.568103 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.568195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.568289 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.568375 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.568473 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.568589 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.568713 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.568803 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.568897 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.568999 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.569113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.569203 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.569296 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.569394 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.569486 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.569571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.569666 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.569760 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.569848 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.569932 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.570024 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.570024 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.570259 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.570259 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.570434 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.570526 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.570627 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.570732 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.570821 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.570914 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.571000 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.571000 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.571142 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.571228 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.571314 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.571314 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.571453 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.571562 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.571667 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.571778 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.571863 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.571936 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.572008 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.572087 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.572160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.572244 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.572326 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.572703 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.572799 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.572873 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.572944 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.573025 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.573107 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.573187 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.573259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.573338 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.573483 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.573584 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.573660 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.573746 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.573827 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.573912 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.574000 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.574086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.574169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.574250 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.574342 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.574436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.574524 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.574606 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.574678 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.574749 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.574826 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.574919 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.575008 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.575105 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.575191 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.575273 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.575346 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.575441 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.575518 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.575598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.575685 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.575759 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.575840 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.575926 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.576002 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.576088 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.576173 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.576257 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.576353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.576447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.576447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.576592 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.576708 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.576782 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.576879 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.576979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.577065 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.577158 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.577245 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.577245 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.577408 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.577504 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.577603 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.577690 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.577785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.577871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.577963 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.578050 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.578134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.578219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.578313 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.578407 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.578492 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.578584 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.578670 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.578781 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.578857 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.578929 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.579001 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.579073 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.579144 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.579224 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.579306 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.579387 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.579466 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.579546 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.579619 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.579704 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.579779 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.579850 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.579929 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.580011 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.580085 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.580165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.580246 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.580327 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.580407 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.580479 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.580560 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.580651 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.580737 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.580825 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.580906 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.580986 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.581073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.581147 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.581225 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.581304 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.581377 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.581484 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.581576 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.581650 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.581729 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.581801 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.581801 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.581935 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.582020 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.582093 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.582163 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.582240 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.582330 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.582411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.582563 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.582654 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.582735 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.582821 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.582895 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.582985 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.583069 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.583142 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.583221 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.583294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.583364 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.583450 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.583532 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.583605 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.583684 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.583756 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.583833 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.583915 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.583990 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.584068 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.584140 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.584218 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.584299 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.584378 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.584457 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.584536 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.584761 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.584862 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.584952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.585032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.585112 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.585112 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.585112 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.585112 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.585442 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.585518 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.585598 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.585678 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.585779 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.585876 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.585950 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.586029 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.586101 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.586172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.586251 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.586335 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.586417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.586497 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.586570 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.586641 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.586719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.586801 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.586882 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.586882 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.587158 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.587477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.587852 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.587967 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.588122 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.588251 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.588436 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.588531 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.588810 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.588910 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.589086 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.589219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.589409 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.589546 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.589727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.589884 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.590031 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.590126 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.590348 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.590455 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.590657 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.590760 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.590968 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.591061 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.591277 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.591370 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.591586 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.591679 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.591915 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.592061 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.592217 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.592312 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.592525 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.592719 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.592877 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.593062 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.593194 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.593320 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.593505 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.593656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.593804 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.593927 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.594134 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.594279 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.594450 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.594617 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.594743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.594916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.595056 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.595197 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.595359 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.595451 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.595655 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.595780 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.595964 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.596074 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.596276 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.596370 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.596583 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.596796 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.596950 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.597042 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.597205 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.597333 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.597519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.597658 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.597827 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.597932 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.598132 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.598281 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.598434 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.598598 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.598744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.598925 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.599065 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.599260 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.599374 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.599581 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.599684 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.599900 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.600031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.600222 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.600318 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.600535 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.600661 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.600903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.601006 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.601213 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.601317 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.601519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.601621 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.601823 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.601917 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.602124 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.602226 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.602449 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.602543 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.603279 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.603403 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.603588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.603686 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.603906 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.604003 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.604226 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.604329 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.604537 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.604685 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.604882 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.604983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.605200 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.605294 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.605505 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.605616 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.605817 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.605917 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.606130 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.606222 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.606440 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.606547 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.606754 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.606856 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.607064 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.607158 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.607376 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.607482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.607687 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.607818 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.608008 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.608113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.608317 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.608425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.608646 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.608758 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.608959 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.609053 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.609262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.609367 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.609573 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.609666 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.609890 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.609984 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.610226 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.610483 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.610577 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.610822 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.610916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.611139 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.611230 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.611451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.611785 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.611879 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.612140 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.612250 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.612460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.612563 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.612819 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.612935 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.613133 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.613234 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.613446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.613539 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.613752 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.613855 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.614062 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.614167 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.614368 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.614470 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.614671 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.614839 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.614977 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.615160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.615280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.615477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.615648 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.615798 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.615893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.616111 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.616204 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.616422 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.616526 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.616765 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.617022 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.617118 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.617329 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.617429 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.617635 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.617740 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.617949 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.618078 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.618254 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.618349 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.619136 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.619292 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.619440 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.619534 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.619761 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.619956 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.620061 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.620321 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.620415 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.620657 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.620767 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.620962 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.621084 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.621304 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.621406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.621614 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.621707 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.621953 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.622057 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.622280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.622374 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.622622 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.622726 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.622928 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.623030 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.623244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.623390 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.623558 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.623739 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.623859 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.623953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.624162 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.624255 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.624464 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.624572 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.624798 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.624901 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.625104 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.625205 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.625406 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.625518 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.625714 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.625816 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.626019 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.626113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.626327 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.626423 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.626633 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.626788 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.626932 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.627118 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.627226 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.627438 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.627540 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.627766 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.627872 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.628098 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.628238 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.628405 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.628505 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.628729 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.628827 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.629038 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.629145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.629344 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.629438 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.629646 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.629748 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.629952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.630047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.630251 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.630389 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.630572 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.630889 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.631032 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.631205 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.631339 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.631516 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.631649 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.631852 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.631961 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.632184 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.632285 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.632494 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.632588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.632848 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.632958 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.633181 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.633278 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.633481 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.633574 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.633786 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.633880 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.634115 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.634224 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.634421 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.634523 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.634724 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.634827 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.635024 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.635118 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.635332 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.635484 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.635652 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.635776 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.635965 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.636067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.636265 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.636359 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.636570 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.636771 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.636893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.636987 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.637180 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.637325 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.637486 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.637651 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.637866 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.637979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.638172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.638419 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.638574 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.638719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.638823 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.638943 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.639047 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.639210 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.639339 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.639546 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.639690 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.639839 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.639956 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.640144 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.640299 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.640454 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.640590 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.640789 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.641052 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.641202 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.641396 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.641492 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.641702 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.641805 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.642006 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.642147 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.642316 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.642419 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.642621 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.642723 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.642951 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.643058 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.643519 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.643627 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.643832 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.643973 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.644140 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.644250 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.644445 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.644554 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.644788 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.644949 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.645100 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.645261 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.645429 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.645601 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.645792 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.645892 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.646020 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.646176 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.646310 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.646405 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.646570 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.646714 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.646861 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.646988 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.647179 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.647311 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.647496 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.647618 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.647819 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.648019 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.648145 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.648285 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.648439 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.648556 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.648733 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.648896 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.649039 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.649187 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.649347 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.649510 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.649719 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.649861 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.649977 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.650181 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.650288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.650580 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.650773 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.650869 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.651085 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.651193 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.651409 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.651525 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.651731 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.651890 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.652049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.652198 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.652342 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.652498 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.652692 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.652804 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.653020 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.653212 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.653352 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.653528 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.653676 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.653838 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.653993 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.654144 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.654333 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.654455 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.654663 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.654773 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.654995 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.655184 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.655339 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.655666 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.655793 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.655987 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.656091 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.656304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.656466 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.656641 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.660586 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.660586 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.660869 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.661002 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.661140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.661238 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.661337 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.661435 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.661528 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.661614 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.661701 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.661794 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.661895 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.661997 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.662086 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.662172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.662266 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.662354 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.662454 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.662543 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.662630 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.662716 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.662810 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.662907 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.662995 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.662995 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.663195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.663284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.663378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.663474 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.663563 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.663649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.663743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.663831 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.663925 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.664026 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.664114 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.664208 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.664296 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.664381 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.664476 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.664476 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.664669 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.664771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.664860 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.664947 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.665049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.665150 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.665744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.665851 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.665929 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.666009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.666092 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.666179 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.666265 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.666350 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.666436 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.666521 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.666649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.666777 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.666962 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.667100 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.667279 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.667422 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.667595 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.667748 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.667908 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.668053 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.668286 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.668454 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.668746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.668880 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.669004 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.669272 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.669368 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.669472 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.669704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.669812 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.670031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.670138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.670300 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.670444 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.670682 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.671019 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.671295 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.671393 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.671779 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.671900 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.671991 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.672076 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.672367 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.672477 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.672628 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.672728 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.672986 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.673092 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.673283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.673389 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.673568 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.674770 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.674770 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.674932 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.675063 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.675168 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.675275 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.675352 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.675446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.675533 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.675620 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.675724 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.675724 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.675885 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.675980 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.676124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.676268 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.676444 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.676530 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.676685 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.676768 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.676855 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.676956 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.677052 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.677264 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.677359 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.677592 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.677685 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.677898 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.678004 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.678207 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.678308 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.679037 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.679162 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.679265 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.679483 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.679668 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.679804 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.679894 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.679969 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.680069 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.680165 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.680248 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.680322 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.680395 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.680475 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.680722 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.680820 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.681052 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.681687 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.681852 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.681982 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.682190 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.682287 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.682515 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.682625 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.682833 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.682937 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.683141 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.683236 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.683456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.683550 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.683778 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.683892 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.684082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.684177 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.684384 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.684486 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.684712 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.684863 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.685016 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.685316 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.685445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.685611 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.685732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.685918 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.686015 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.686218 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.686377 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.686520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.686630 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.686819 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.687003 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.687149 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.687254 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.687430 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.687536 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.687750 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.687905 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.688057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.688180 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.688357 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.688516 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.688708 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.688873 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.689000 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.689091 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.689472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.689787 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.690000 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.690099 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.690325 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.690457 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.690665 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.690793 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.690984 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.691119 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.691303 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.691397 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.691618 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.691725 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.691932 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.692024 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.692247 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.692353 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.692563 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.692704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.692907 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.693002 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.693225 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.693328 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.693541 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.693633 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.693854 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.693973 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.694170 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.694278 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.694484 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.694577 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.694800 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.694892 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.695114 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.695369 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.695472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.695697 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.695825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.696010 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.696104 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.696321 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.696458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.696682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.696794 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.696999 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.697143 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.697318 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.697473 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.697729 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.697837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.698041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.698145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.698353 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.698479 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.698663 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.698789 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.698994 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.699106 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.699315 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.699457 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.699649 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.699853 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.699971 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.700053 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.700286 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.700400 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.700837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.700949 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.701996 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.702132 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.702250 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.702370 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.702466 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.702552 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.702658 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.702755 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.702837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.702923 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.703018 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.703103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.703191 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.703264 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.703346 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.703440 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.703535 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.703704 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.703794 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.703915 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.704020 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.704134 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.704281 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.704444 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.704592 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.704781 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.704920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.705089 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.705228 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.705401 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.705540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.705713 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.705846 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.706034 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.706221 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.706365 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.706468 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.706681 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.706780 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.707087 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.707205 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.707297 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.707503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.707614 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.707814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.708043 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.708140 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.708230 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.708430 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.708535 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.708785 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.708928 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.709235 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.709408 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.709511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.709646 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.709745 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.709849 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.710095 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.710200 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.710394 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.710489 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.710700 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.710811 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.711004 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.711100 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.711311 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.711542 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.711653 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.711806 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.711910 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.712123 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.712267 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.712344 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.712544 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.712672 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.712873 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.712990 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.713189 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.713284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.713496 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.713592 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.713829 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.714027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.714145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.714376 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.714480 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.714692 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.714788 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.715079 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.715415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.715660 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.715771 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.715994 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.716098 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.716312 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.716423 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.716638 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.716753 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.716970 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.717089 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.717276 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.717377 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.717611 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.717953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.718060 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.718267 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.718363 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.718581 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.718686 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.718886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.718991 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.719192 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.719288 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.719502 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.719598 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.719812 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.719918 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.720116 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.720218 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.720424 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.720564 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.720750 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.720847 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.721076 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.721184 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.721383 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.721485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.721686 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.721791 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.721992 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.722096 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.722339 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.722438 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.722642 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.722736 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.723001 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.723106 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.723324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.723427 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.723627 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.723784 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.723940 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.724046 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.724240 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.724366 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.724637 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.724736 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.724866 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 12:25:28.724972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.725265 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.725614 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.725924 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.726227 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.726547 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.726926 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.727231 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.727544 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.728377 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.728722 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.729096 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.729418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.729766 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.730080 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.730634 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.730970 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.731295 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.731667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.731967 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.732274 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.732585 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.732926 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.733249 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.733559 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.733873 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.734182 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.735942 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.735942 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.735942 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.735942 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.735942 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.736421 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.736421 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.736661 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.737089 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.737272 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.737578 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.737890 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.738229 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.738545 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.738859 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.739196 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.739519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.739837 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.740138 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.740443 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.740776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.741090 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.741416 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.741730 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.742033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.742460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.742775 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.743090 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.743485 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.744288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.744618 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.744949 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.745262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.745584 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.746196 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.746196 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.746544 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.746869 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.747194 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.747502 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.747804 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.748105 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.748412 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.748749 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.749076 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.749361 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.749661 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.749964 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.750266 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.750567 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.750867 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.751168 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.751472 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.751852 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.752156 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.752454 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.752789 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.753090 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.753392 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.753695 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.753993 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.754294 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.754591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.754889 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.755187 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.755514 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.755844 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.756155 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.756474 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.756809 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.757126 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.757437 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.757756 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.758069 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.758383 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.758689 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.759035 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.759342 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.759651 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.759957 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.760264 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.760569 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.760897 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.761223 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.761539 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.761843 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.762169 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.762483 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.762805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.763203 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.763544 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.763869 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.764178 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.764486 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.764815 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.765124 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.765431 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.765741 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.766046 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.766353 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.766664 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.766974 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.767296 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.767617 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.767923 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.768511 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.768858 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.769202 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.769538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.769882 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.770175 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.770484 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.770790 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.771159 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 12:25:28.771424 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 12:25:28.787363 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO dbcounter [None req-821a5372-270e-48b4-a096-21eab1d71d3b None None] Registered counter for database nova_api Sep 19 12:25:28.808400 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_db.sqlalchemy.engines [None req-821a5372-270e-48b4-a096-21eab1d71d3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121429) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 12:25:28.815466 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writer thread running {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 12:25:28.834125 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO dbcounter [None req-24b2831e-2a35-4a9f-aaae-454ddb572f4f None None] Registered counter for database nova_api Sep 19 12:25:28.855352 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_db.sqlalchemy.engines [None req-24b2831e-2a35-4a9f-aaae-454ddb572f4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121428) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 12:25:28.862084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writer thread running {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 12:25:28.873352 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.context [None req-821a5372-270e-48b4-a096-21eab1d71d3b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f85a1a4f-73ae-4199-a51b-3478744f2b7e(cell1) {{(pid=121429) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 12:25:28.877959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-821a5372-270e-48b4-a096-21eab1d71d3b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:28.877959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-821a5372-270e-48b4-a096-21eab1d71d3b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:28.879520 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-821a5372-270e-48b4-a096-21eab1d71d3b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:28.880269 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-821a5372-270e-48b4-a096-21eab1d71d3b None None] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:28.880740 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-821a5372-270e-48b4-a096-21eab1d71d3b None None] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:28.882785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-821a5372-270e-48b4-a096-21eab1d71d3b None None] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:28.884941 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO dbcounter [None req-821a5372-270e-48b4-a096-21eab1d71d3b None None] Registered counter for database nova_cell0 Sep 19 12:25:28.889173 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO dbcounter [None req-821a5372-270e-48b4-a096-21eab1d71d3b None None] Registered counter for database nova_cell1 Sep 19 12:25:28.897791 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_db.sqlalchemy.engines [None req-821a5372-270e-48b4-a096-21eab1d71d3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121429) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 12:25:28.899167 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_db.sqlalchemy.engines [None req-821a5372-270e-48b4-a096-21eab1d71d3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121429) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 12:25:28.906673 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writer thread running {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 12:25:28.907983 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writer thread running {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 12:25:28.918816 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.context [None req-24b2831e-2a35-4a9f-aaae-454ddb572f4f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f85a1a4f-73ae-4199-a51b-3478744f2b7e(cell1) {{(pid=121428) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 12:25:28.923215 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-24b2831e-2a35-4a9f-aaae-454ddb572f4f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:28.923684 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-24b2831e-2a35-4a9f-aaae-454ddb572f4f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:28.925321 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-24b2831e-2a35-4a9f-aaae-454ddb572f4f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:28.926053 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-24b2831e-2a35-4a9f-aaae-454ddb572f4f None None] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:28.926493 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-24b2831e-2a35-4a9f-aaae-454ddb572f4f None None] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:28.928498 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-24b2831e-2a35-4a9f-aaae-454ddb572f4f None None] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:28.930545 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO dbcounter [None req-24b2831e-2a35-4a9f-aaae-454ddb572f4f None None] Registered counter for database nova_cell0 Sep 19 12:25:28.934786 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO dbcounter [None req-24b2831e-2a35-4a9f-aaae-454ddb572f4f None None] Registered counter for database nova_cell1 Sep 19 12:25:28.943495 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_db.sqlalchemy.engines [None req-24b2831e-2a35-4a9f-aaae-454ddb572f4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121428) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 12:25:28.945564 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_db.sqlalchemy.engines [None req-24b2831e-2a35-4a9f-aaae-454ddb572f4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121428) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 12:25:28.951842 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writer thread running {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 12:25:28.953146 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writer thread running {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 12:25:29.061820 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO dbcounter [None req-821a5372-270e-48b4-a096-21eab1d71d3b None None] Registered counter for database nova_cell0 Sep 19 12:25:29.069474 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_db.sqlalchemy.engines [None req-821a5372-270e-48b4-a096-21eab1d71d3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121429) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 12:25:29.074117 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writer thread running {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 12:25:29.104095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO dbcounter [None req-24b2831e-2a35-4a9f-aaae-454ddb572f4f None None] Registered counter for database nova_cell0 Sep 19 12:25:29.115376 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_db.sqlalchemy.engines [None req-24b2831e-2a35-4a9f-aaae-454ddb572f4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121428) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 12:25:29.121202 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writer thread running {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 12:25:29.402958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: WARNING keystonemiddleware.auth_token [None req-821a5372-270e-48b4-a096-21eab1d71d3b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 12:25:29.410511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: WARNING keystonemiddleware.auth_token [None req-821a5372-270e-48b4-a096-21eab1d71d3b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 12:25:29.450023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: WARNING keystonemiddleware.auth_token [None req-24b2831e-2a35-4a9f-aaae-454ddb572f4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 12:25:29.457580 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: WARNING keystonemiddleware.auth_token [None req-24b2831e-2a35-4a9f-aaae-454ddb572f4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 12:25:29.784994 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: WARNING keystonemiddleware.auth_token [None req-821a5372-270e-48b4-a096-21eab1d71d3b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 12:25:29.791210 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: WARNING keystonemiddleware.auth_token [None req-821a5372-270e-48b4-a096-21eab1d71d3b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 12:25:29.796664 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b9239e89c0 pid: 121429 (default app) Sep 19 12:25:29.807987 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: WARNING keystonemiddleware.auth_token [None req-24b2831e-2a35-4a9f-aaae-454ddb572f4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 12:25:29.814096 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: WARNING keystonemiddleware.auth_token [None req-24b2831e-2a35-4a9f-aaae-454ddb572f4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 12:25:29.819433 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b9239e89c0 pid: 121428 (default app) Sep 19 12:26:07.986792 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=3 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:07.988327 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=3 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:07.989209 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=3 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:07.989945 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=3 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:09.231488 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-02f41e5b-10c0-41e3-8418-3d80f0568951 tempest-VolumesGetTestJSON-716999973 tempest-VolumesGetTestJSON-716999973-project] Action: 'create', calling method: .version_select at 0x7f54b45684c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-930708671", "metadata": {"Type": "work"}}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:26:12.501717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-02f41e5b-10c0-41e3-8418-3d80f0568951 tempest-VolumesGetTestJSON-716999973 tempest-VolumesGetTestJSON-716999973-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.522703 Sep 19 12:26:12.522367 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 1/1] 10.222.0.93 () {60 vars in 1156 bytes} [Mon Sep 19 12:26:07 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4528 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 19 12:26:12.531313 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=3 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:12.532385 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=3 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:12.533149 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=3 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:12.533855 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=3 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:12.710023 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-de5dc7b9-e19e-406c-92c0-ae80c16f997c tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] Calling method '.version_select at 0x7f54b443a3a0>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:13.071686 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-de5dc7b9-e19e-406c-92c0-ae80c16f997c tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/d5943b81-4387-4d52-82a6-4c9a8c607e6f" status: 200 len: 350 microversion: 2.1 time: 0.377106 Sep 19 12:26:13.081336 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 2/2] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Sep 19 12:26:12 2022] GET /compute/v2.1/os-volumes/d5943b81-4387-4d52-82a6-4c9a8c607e6f => generated 350 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:26:13.390262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ac7147ea-c71c-4120-8fcd-9d4eca6933fa tempest-VolumesGetTestJSON-716999973 tempest-VolumesGetTestJSON-716999973-project] Calling method '.version_select at 0x7f54b45bb040>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:14.176563 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ac7147ea-c71c-4120-8fcd-9d4eca6933fa tempest-VolumesGetTestJSON-716999973 tempest-VolumesGetTestJSON-716999973-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/fc6e5e42-6a30-4eb4-924a-60587cc2491f" status: 200 len: 353 microversion: 2.1 time: 1.652046 Sep 19 12:26:14.177166 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 1/3] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Sep 19 12:26:12 2022] GET /compute/v2.1/os-volumes/fc6e5e42-6a30-4eb4-924a-60587cc2491f => generated 353 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:26:14.190797 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9de4edb6-4177-4909-8eb7-4d0997143b2d tempest-VolumesGetTestJSON-716999973 tempest-VolumesGetTestJSON-716999973-project] Calling method '.version_select at 0x7f54b443aaf0>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:14.392492 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9de4edb6-4177-4909-8eb7-4d0997143b2d tempest-VolumesGetTestJSON-716999973 tempest-VolumesGetTestJSON-716999973-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/fc6e5e42-6a30-4eb4-924a-60587cc2491f" status: 200 len: 353 microversion: 2.1 time: 0.189666 Sep 19 12:26:14.392492 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 3/4] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Sep 19 12:26:14 2022] GET /compute/v2.1/os-volumes/fc6e5e42-6a30-4eb4-924a-60587cc2491f => generated 353 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:26:14.397459 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-77ec6a32-c5ae-49be-90d5-fecbb6804966 tempest-VolumesGetTestJSON-716999973 tempest-VolumesGetTestJSON-716999973-project] Calling method '.version_select at 0x7f54b44275e0>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:15.789743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-77ec6a32-c5ae-49be-90d5-fecbb6804966 tempest-VolumesGetTestJSON-716999973 tempest-VolumesGetTestJSON-716999973-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/fc6e5e42-6a30-4eb4-924a-60587cc2491f" status: 202 len: 0 microversion: 2.1 time: 1.396518 Sep 19 12:26:15.791524 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 2/5] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Sep 19 12:26:14 2022] DELETE /compute/v2.1/os-volumes/fc6e5e42-6a30-4eb4-924a-60587cc2491f => generated 0 bytes in 1399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:26:15.801994 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-08d34f86-8f29-4903-a8d2-3aaa9a30d108 tempest-VolumesGetTestJSON-716999973 tempest-VolumesGetTestJSON-716999973-project] Calling method '.version_select at 0x7f54b43d31f0>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:16.036517 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8e468860-019b-4d97-bf8f-47b388058311 tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] Calling method '.version_select at 0x7f54b4427040>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:16.123204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-08d34f86-8f29-4903-a8d2-3aaa9a30d108 tempest-VolumesGetTestJSON-716999973 tempest-VolumesGetTestJSON-716999973-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/fc6e5e42-6a30-4eb4-924a-60587cc2491f" status: 200 len: 352 microversion: 2.1 time: 0.324443 Sep 19 12:26:16.129929 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 4/6] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Sep 19 12:26:15 2022] GET /compute/v2.1/os-volumes/fc6e5e42-6a30-4eb4-924a-60587cc2491f => generated 352 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:26:16.196920 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8e468860-019b-4d97-bf8f-47b388058311 tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/256779d8-81c6-44fd-8fa7-627bfd05aa21" status: 200 len: 350 microversion: 2.1 time: 0.165016 Sep 19 12:26:16.197569 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 3/7] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Sep 19 12:26:16 2022] GET /compute/v2.1/os-volumes/256779d8-81c6-44fd-8fa7-627bfd05aa21 => generated 350 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:26:16.870090 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2935598b-5237-4ffa-9ee2-230cef208f7c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-784648420", "imageRef": "d4301833-8e96-46bf-a940-692f93f7fdba", "flavorRef": "452", "networks": [{"uuid": "81100c72-7f37-407d-a856-a5824fefc080"}]}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:26:16.987532 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.network.neutron [None req-2935598b-5237-4ffa-9ee2-230cef208f7c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] validate_networks() for [('81100c72-7f37-407d-a856-a5824fefc080', None, None, None, None, None)] {{(pid=121429) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:26:17.139803 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8ebfe301-d5f6-43eb-b36e-6d60a068ad28 tempest-VolumesGetTestJSON-716999973 tempest-VolumesGetTestJSON-716999973-project] Calling method '.version_select at 0x7f54b4427b80>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:17.396062 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-8ebfe301-d5f6-43eb-b36e-6d60a068ad28 tempest-VolumesGetTestJSON-716999973 tempest-VolumesGetTestJSON-716999973-project] HTTP exception thrown: Volume fc6e5e42-6a30-4eb4-924a-60587cc2491f could not be found. Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8ebfe301-d5f6-43eb-b36e-6d60a068ad28 tempest-VolumesGetTestJSON-716999973 tempest-VolumesGetTestJSON-716999973-project] Request method failure captured: Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/os-volumes/fc6e5e42-6a30-4eb4-924a-60587cc2491f HTTP/1.1 Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKF_fwe3aQY8UWCf-cBUhwov_0LrVo97eprLfr2X0MFof_H6H6gRexjvLOibsXPfoOtZ1BvDs1H2mTdMJjZ7Th4L9FSbDP8d1oMuL-1weEfaU3SD45_e6gwgC-RiMPmHrp7Wa-7jFACK0zL0CZ5lXM6Kf_G0Cjs-u9Vs5ckZ509tp6NE Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 7f0891a875b0465b943caa507508575e Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-VolumesGetTestJSON-716999973 Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:26:17.400780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:26:17.401874 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7f0891a875b0465b943caa507508575e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7f0891a875b0465b943caa507508575e", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7f0891a875b0465b943caa507508575e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7f0891a875b0465b943caa507508575e"}]}] Sep 19 12:26:17.401874 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-VolumesGetTestJSON-716999973 Sep 19 12:26:17.401874 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 7f0891a875b0465b943caa507508575e Sep 19 12:26:17.401874 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-VolumesGetTestJSON-716999973 Sep 19 12:26:17.401874 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-VolumesGetTestJSON-716999973-project Sep 19 12:26:17.401874 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:26:17.401874 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:26:17.401874 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: c7cfa2adca2c4e3b89917d86e1a55631 Sep 19 12:26:17.401874 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-VolumesGetTestJSON-716999973-project Sep 19 12:26:17.401874 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: Sep 19 12:26:17.401874 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Volume fc6e5e42-6a30-4eb4-924a-60587cc2491f could not be found. Sep 19 12:26:17.401874 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': 'fc6e5e42-6a30-4eb4-924a-60587cc2491f'} Sep 19 12:26:17.401874 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:26:17.402726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:26:17.402726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 12:26:17.402726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 12:26:17.402726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 12:26:17.402726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 12:26:17.402726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 12:26:17.402726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 12:26:17.402726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 12:26:17.402726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 12:26:17.402726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 12:26:17.402726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 12:26:17.402726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 12:26:17.402726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 12:26:17.402726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 12:26:17.402726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 12:26:17.402726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fc6e5e42-6a30-4eb4-924a-60587cc2491f could not be found. (HTTP 404) (Request-ID: req-d57d3ed3-9df7-4f4d-904d-687e847bd3dd) Sep 19 12:26:17.402726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:26:17.402726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:26:17.402726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:26:17.404418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:26:17.404418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 12:26:17.404418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 12:26:17.404418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 12:26:17.404418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 12:26:17.404418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 12:26:17.404418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 12:26:17.404418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 12:26:17.404418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 12:26:17.404418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 12:26:17.404418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 12:26:17.404418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 12:26:17.404418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 12:26:17.404418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 12:26:17.404418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 12:26:17.404418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 12:26:17.404418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 12:26:17.404418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 12:26:17.404418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 12:26:17.405388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 12:26:17.405388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 12:26:17.405388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 12:26:17.405388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 12:26:17.405388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fc6e5e42-6a30-4eb4-924a-60587cc2491f could not be found. Sep 19 12:26:17.405388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:26:17.405388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:26:17.405388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:26:17.405388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:26:17.405388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:26:17.405388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:26:17.405388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:26:17.405388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:26:17.405388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 12:26:17.405388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 12:26:17.405388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:26:17.405388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:26:17.405388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 12:26:17.405388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:26:17.415593 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fc6e5e42-6a30-4eb4-924a-60587cc2491f could not be found. Sep 19 12:26:17.415593 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:26:17.415593 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:26:17.415593 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:26:17.415593 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:26:17.415593 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:26:17.415593 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:26:17.415593 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:26:17.415593 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:26:17.415593 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fc6e5e42-6a30-4eb4-924a-60587cc2491f could not be found. Sep 19 12:26:17.415593 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:26:17.415593 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8ebfe301-d5f6-43eb-b36e-6d60a068ad28 tempest-VolumesGetTestJSON-716999973 tempest-VolumesGetTestJSON-716999973-project] Returning 404 to user: Volume fc6e5e42-6a30-4eb4-924a-60587cc2491f could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:26:17.415593 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8ebfe301-d5f6-43eb-b36e-6d60a068ad28 tempest-VolumesGetTestJSON-716999973 tempest-VolumesGetTestJSON-716999973-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/fc6e5e42-6a30-4eb4-924a-60587cc2491f" status: 404 len: 109 microversion: 2.1 time: 0.271017 Sep 19 12:26:17.415593 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 4/8] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Sep 19 12:26:17 2022] GET /compute/v2.1/os-volumes/fc6e5e42-6a30-4eb4-924a-60587cc2491f => generated 109 bytes in 273 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 12:26:18.719849 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-2935598b-5237-4ffa-9ee2-230cef208f7c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Flavor limits 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:26:18.720327 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-2935598b-5237-4ffa-9ee2-230cef208f7c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Image limits 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:26:18.720830 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-2935598b-5237-4ffa-9ee2-230cef208f7c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Flavor pref 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:26:18.721414 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-2935598b-5237-4ffa-9ee2-230cef208f7c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Image pref 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:26:18.722215 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-2935598b-5237-4ffa-9ee2-230cef208f7c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:26:18.758970 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2935598b-5237-4ffa-9ee2-230cef208f7c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:18.759614 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2935598b-5237-4ffa-9ee2-230cef208f7c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:18.760071 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2935598b-5237-4ffa-9ee2-230cef208f7c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:18.764435 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2935598b-5237-4ffa-9ee2-230cef208f7c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:18.771525 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2935598b-5237-4ffa-9ee2-230cef208f7c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:18.771525 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2935598b-5237-4ffa-9ee2-230cef208f7c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:18.821591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a0ce563e-5767-432b-8b56-f6d755e7326c tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] Calling method '.version_select at 0x7f54b4d969d0>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:18.859754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-2935598b-5237-4ffa-9ee2-230cef208f7c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Getting quotas for project 70886a6d77434c90b59efd86c2395088. Resources: {'instances', 'ram', 'cores'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:26:18.888669 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-2935598b-5237-4ffa-9ee2-230cef208f7c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Getting quotas for user 825be558d6544a848293628e36b48c06 and project 70886a6d77434c90b59efd86c2395088. Resources: {'instances', 'ram', 'cores'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:26:18.906735 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a0ce563e-5767-432b-8b56-f6d755e7326c tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/8d65b5a8-25fb-4cb9-adc8-096b2dcf8156" status: 200 len: 351 microversion: 2.1 time: 0.091231 Sep 19 12:26:18.907688 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 5/9] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Sep 19 12:26:18 2022] GET /compute/v2.1/os-volumes/8d65b5a8-25fb-4cb9-adc8-096b2dcf8156 => generated 351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:26:18.921232 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f34c2403-42a9-42e4-8ae3-15ee609fa2c3 tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] Calling method '.version_select at 0x7f54b4427a60>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:18.953579 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2935598b-5237-4ffa-9ee2-230cef208f7c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Going to run 1 instances... {{(pid=121429) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:26:18.973272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2935598b-5237-4ffa-9ee2-230cef208f7c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4301833-8e96-46bf-a940-692f93f7fdba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121429) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:26:19.125003 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f34c2403-42a9-42e4-8ae3-15ee609fa2c3 tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] 10.222.0.93 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.207694 Sep 19 12:26:19.125575 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 6/10] 10.222.0.93 () {58 vars in 1134 bytes} [Mon Sep 19 12:26:18 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:19.141797 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-86f0e7a3-7e2f-48b0-8098-c7f6b59a2cb5 tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] Calling method '.version_select at 0x7f54b4427820>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:19.343625 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-86f0e7a3-7e2f-48b0-8098-c7f6b59a2cb5 tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] 10.222.0.93 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.195191 Sep 19 12:26:19.343625 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 7/11] 10.222.0.93 () {58 vars in 1149 bytes} [Mon Sep 19 12:26:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:26:19.350538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-eeeedc97-d8f5-4e1b-ae4f-6f98f432c0cc tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] Calling method '.version_select at 0x7f54b439c3a0>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:19.369246 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2935598b-5237-4ffa-9ee2-230cef208f7c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.556501 Sep 19 12:26:19.373935 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 5/12] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:26:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:26:19.384709 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-506327ec-0ab1-40f0-b776-23bc93c6c177 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:19.386424 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-506327ec-0ab1-40f0-b776-23bc93c6c177 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:19.546300 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-eeeedc97-d8f5-4e1b-ae4f-6f98f432c0cc tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] 10.222.0.93 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.199503 Sep 19 12:26:19.547282 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 8/13] 10.222.0.93 () {58 vars in 1134 bytes} [Mon Sep 19 12:26:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:19.561938 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-1c5f02af-4c8f-49ac-b178-3e16417ece32 tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] Calling method '.version_select at 0x7f54b439c040>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:19.600266 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-506327ec-0ab1-40f0-b776-23bc93c6c177 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:19.641696 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-506327ec-0ab1-40f0-b776-23bc93c6c177 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1214 microversion: 2.1 time: 0.261280 Sep 19 12:26:19.645161 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 6/14] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:19 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1214 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:19.788920 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-1c5f02af-4c8f-49ac-b178-3e16417ece32 tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] 10.222.0.93 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.230220 Sep 19 12:26:19.789648 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 9/15] 10.222.0.93 () {58 vars in 1167 bytes} [Mon Sep 19 12:26:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:26:19.805221 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2bda8c21-455b-4ed3-b0d6-301c994352a7 tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] Calling method '.version_select at 0x7f54b3afd310>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:19.916952 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2bda8c21-455b-4ed3-b0d6-301c994352a7 tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.115486 Sep 19 12:26:19.917767 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 7/16] 10.222.0.93 () {58 vars in 1170 bytes} [Mon Sep 19 12:26:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:26:19.935614 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-9a6f294e-19bf-4dbe-9ffc-7421b6919516 tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] Calling method '.version_select at 0x7f54b4427af0>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:20.108737 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-9a6f294e-19bf-4dbe-9ffc-7421b6919516 tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.177092 Sep 19 12:26:20.109777 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 10/17] 10.222.0.93 () {58 vars in 1155 bytes} [Mon Sep 19 12:26:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:20.126414 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ff084ce5-6871-4de8-bde9-d8140ee5910d tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] Calling method '.version_select at 0x7f54b3a99820>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:20.402465 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ff084ce5-6871-4de8-bde9-d8140ee5910d tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.283143 Sep 19 12:26:20.403218 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 8/18] 10.222.0.93 () {58 vars in 1188 bytes} [Mon Sep 19 12:26:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:26:20.419216 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-052b98ad-2e03-4836-ab6c-db8911465dd2 tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] Calling method '.version_select at 0x7f54b43aea60>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:20.581906 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-052b98ad-2e03-4836-ab6c-db8911465dd2 tempest-VolumesTestJSON-561373486 tempest-VolumesTestJSON-561373486-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.169416 Sep 19 12:26:20.596550 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 11/19] 10.222.0.93 () {58 vars in 1155 bytes} [Mon Sep 19 12:26:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:20.670011 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-42cfa629-462b-42f6-93d3-d3abe411a92c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:20.670750 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-42cfa629-462b-42f6-93d3-d3abe411a92c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:20.873833 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-42cfa629-462b-42f6-93d3-d3abe411a92c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:20.895239 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-42cfa629-462b-42f6-93d3-d3abe411a92c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1214 microversion: 2.1 time: 0.231130 Sep 19 12:26:20.895849 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 9/20] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:20 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1214 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:21.838738 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-628b0ebd-ae97-4576-8da1-742efbc6e852 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-787457268", "imageRef": "d4301833-8e96-46bf-a940-692f93f7fdba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:26:21.919378 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e60ce741-0331-4db8-b039-5ac9dc6ed373 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:21.920004 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-e60ce741-0331-4db8-b039-5ac9dc6ed373 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:22.081966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e60ce741-0331-4db8-b039-5ac9dc6ed373 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:22.089934 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e60ce741-0331-4db8-b039-5ac9dc6ed373 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1214 microversion: 2.1 time: 0.174563 Sep 19 12:26:22.090522 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 10/21] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:21 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1214 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:22.169330 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.network.neutron [None req-628b0ebd-ae97-4576-8da1-742efbc6e852 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] validate_networks() for [('cfe95f3e-3dda-428e-b0b1-ae445a370fb3', None, None, None, None, None)] {{(pid=121428) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:26:23.122302 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-cb0f7a86-5f60-4e8a-9a47-abbf8cdb0634 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:23.124159 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-cb0f7a86-5f60-4e8a-9a47-abbf8cdb0634 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:23.137813 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cb0f7a86-5f60-4e8a-9a47-abbf8cdb0634 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:23.146136 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cb0f7a86-5f60-4e8a-9a47-abbf8cdb0634 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:23.149237 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cb0f7a86-5f60-4e8a-9a47-abbf8cdb0634 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:23.150196 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cb0f7a86-5f60-4e8a-9a47-abbf8cdb0634 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:23.154536 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cb0f7a86-5f60-4e8a-9a47-abbf8cdb0634 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:23.155858 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cb0f7a86-5f60-4e8a-9a47-abbf8cdb0634 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:23.562440 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-cb0f7a86-5f60-4e8a-9a47-abbf8cdb0634 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:23.592116 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-cb0f7a86-5f60-4e8a-9a47-abbf8cdb0634 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1218 microversion: 2.1 time: 0.474058 Sep 19 12:26:23.592770 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 11/22] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:23 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1218 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:23.632291 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-628b0ebd-ae97-4576-8da1-742efbc6e852 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Flavor limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:26:23.632291 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-628b0ebd-ae97-4576-8da1-742efbc6e852 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Image limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:26:23.632291 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-628b0ebd-ae97-4576-8da1-742efbc6e852 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Flavor pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:26:23.632291 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-628b0ebd-ae97-4576-8da1-742efbc6e852 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Image pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:26:23.632291 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-628b0ebd-ae97-4576-8da1-742efbc6e852 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:26:23.656343 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-628b0ebd-ae97-4576-8da1-742efbc6e852 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:23.656903 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-628b0ebd-ae97-4576-8da1-742efbc6e852 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:23.657720 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-628b0ebd-ae97-4576-8da1-742efbc6e852 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:23.659016 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-628b0ebd-ae97-4576-8da1-742efbc6e852 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:23.659519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-628b0ebd-ae97-4576-8da1-742efbc6e852 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:23.660576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-628b0ebd-ae97-4576-8da1-742efbc6e852 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:23.718912 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-628b0ebd-ae97-4576-8da1-742efbc6e852 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Getting quotas for project b4cb72be6f7d411fbfd037aebc273cb2. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:26:23.745069 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-628b0ebd-ae97-4576-8da1-742efbc6e852 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Getting quotas for user 90ec87808ac641329bc1491d1b5473d9 and project b4cb72be6f7d411fbfd037aebc273cb2. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:26:23.786368 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-628b0ebd-ae97-4576-8da1-742efbc6e852 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Going to run 1 instances... {{(pid=121428) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:26:23.797993 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-628b0ebd-ae97-4576-8da1-742efbc6e852 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4301833-8e96-46bf-a940-692f93f7fdba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:26:24.012825 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-628b0ebd-ae97-4576-8da1-742efbc6e852 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.545251 Sep 19 12:26:24.015408 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 12/23] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:26:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 2547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:26:24.029386 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-bbd778e1-721e-419b-9453-a94d88e18e7d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:24.030022 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-bbd778e1-721e-419b-9453-a94d88e18e7d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:24.170425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-bbd778e1-721e-419b-9453-a94d88e18e7d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:24.182922 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-bbd778e1-721e-419b-9453-a94d88e18e7d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1221 microversion: 2.1 time: 0.154958 Sep 19 12:26:24.187708 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 12/24] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:24 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1221 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:24.512533 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-6b788d6f-9f70-4c09-887c-66faf9f40fc7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-599241481", "imageRef": "d4301833-8e96-46bf-a940-692f93f7fdba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:26:24.627556 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e9fcbdca-4488-4535-b7dc-e25e6bd2b776 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:24.628287 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-e9fcbdca-4488-4535-b7dc-e25e6bd2b776 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:24.642990 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e9fcbdca-4488-4535-b7dc-e25e6bd2b776 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:24.644508 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e9fcbdca-4488-4535-b7dc-e25e6bd2b776 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:24.657531 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e9fcbdca-4488-4535-b7dc-e25e6bd2b776 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:24.657531 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e9fcbdca-4488-4535-b7dc-e25e6bd2b776 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:24.657531 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e9fcbdca-4488-4535-b7dc-e25e6bd2b776 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:24.657531 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e9fcbdca-4488-4535-b7dc-e25e6bd2b776 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:24.668700 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.network.neutron [None req-6b788d6f-9f70-4c09-887c-66faf9f40fc7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] validate_networks() for [('cfe95f3e-3dda-428e-b0b1-ae445a370fb3', None, None, None, None, None)] {{(pid=121428) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:26:24.945289 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e9fcbdca-4488-4535-b7dc-e25e6bd2b776 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:24.957164 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e9fcbdca-4488-4535-b7dc-e25e6bd2b776 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1218 microversion: 2.1 time: 0.331530 Sep 19 12:26:24.957974 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 13/25] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:24 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1218 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:25.744195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-6b788d6f-9f70-4c09-887c-66faf9f40fc7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Flavor limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:26:25.745284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-6b788d6f-9f70-4c09-887c-66faf9f40fc7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Image limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:26:25.745902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-6b788d6f-9f70-4c09-887c-66faf9f40fc7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Flavor pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:26:25.746625 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-6b788d6f-9f70-4c09-887c-66faf9f40fc7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Image pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:26:25.747410 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-6b788d6f-9f70-4c09-887c-66faf9f40fc7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:26:25.772081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6b788d6f-9f70-4c09-887c-66faf9f40fc7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:25.773527 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6b788d6f-9f70-4c09-887c-66faf9f40fc7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:25.779228 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6b788d6f-9f70-4c09-887c-66faf9f40fc7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:25.779228 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6b788d6f-9f70-4c09-887c-66faf9f40fc7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:25.780156 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6b788d6f-9f70-4c09-887c-66faf9f40fc7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:25.780818 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6b788d6f-9f70-4c09-887c-66faf9f40fc7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:25.863680 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-6b788d6f-9f70-4c09-887c-66faf9f40fc7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Getting quotas for project b4cb72be6f7d411fbfd037aebc273cb2. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:26:25.871469 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-6b788d6f-9f70-4c09-887c-66faf9f40fc7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Getting quotas for user 90ec87808ac641329bc1491d1b5473d9 and project b4cb72be6f7d411fbfd037aebc273cb2. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:26:25.908049 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6b788d6f-9f70-4c09-887c-66faf9f40fc7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Going to run 1 instances... {{(pid=121428) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:26:25.910468 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6b788d6f-9f70-4c09-887c-66faf9f40fc7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4301833-8e96-46bf-a940-692f93f7fdba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:26:26.170693 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-6b788d6f-9f70-4c09-887c-66faf9f40fc7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.664611 Sep 19 12:26:26.180157 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 13/26] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:26:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 1675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:26:26.216828 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c1805327-24ba-4117-90e1-0313c81a5310 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:26.216828 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c1805327-24ba-4117-90e1-0313c81a5310 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:26.291012 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e070fa2c-5489-48c6-abec-95a9ebf47ad4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Action: 'create', calling method: .version_select at 0x7f54b39d1280>, body: {"keypair": {"name": "tempest-keypair-322976130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8y9055iaNMI3K+zGbgjovMoMSiDSEyAtjteKbVMu9ek8NVrfFntmxxlYZ2d+wBqLglbEQAiNi5Fm+EMhngfwbMe8GsostzX4IBBSoCJlyYC4pl3ATthPGIy4rvpWjIfw=="}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:26:26.297440 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c1805327-24ba-4117-90e1-0313c81a5310 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:26.297937 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c1805327-24ba-4117-90e1-0313c81a5310 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:26.298376 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c1805327-24ba-4117-90e1-0313c81a5310 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:26.299167 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c1805327-24ba-4117-90e1-0313c81a5310 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:26.299622 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c1805327-24ba-4117-90e1-0313c81a5310 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:26.300045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c1805327-24ba-4117-90e1-0313c81a5310 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:26.446240 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-e070fa2c-5489-48c6-abec-95a9ebf47ad4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Getting quotas for project 68496d9aa29542139f00104051248a5b. Resources: {'key_pairs'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:26:26.495105 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-e070fa2c-5489-48c6-abec-95a9ebf47ad4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Getting quotas for user 3a48e0ab477f43d294607d441af0b444 and project 68496d9aa29542139f00104051248a5b. Resources: {'key_pairs'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:26:26.743249 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c1805327-24ba-4117-90e1-0313c81a5310 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:26.759330 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e070fa2c-5489-48c6-abec-95a9ebf47ad4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.906338 Sep 19 12:26:26.759995 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 14/27] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Sep 19 12:26:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:26:26.784468 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-13ecddf4-5907-4956-97c3-4c8a77246e91 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:26.785868 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-13ecddf4-5907-4956-97c3-4c8a77246e91 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:26.798840 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c1805327-24ba-4117-90e1-0313c81a5310 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1266 microversion: 2.1 time: 0.611891 Sep 19 12:26:26.806581 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 14/28] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:26 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1266 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:26.998796 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-13ecddf4-5907-4956-97c3-4c8a77246e91 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:27.009047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-13ecddf4-5907-4956-97c3-4c8a77246e91 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1221 microversion: 2.1 time: 0.246412 Sep 19 12:26:27.024091 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 15/29] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:26 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1221 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:27.491161 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-90cab58b-258b-41ef-ab01-c1a31f283f52 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Action: 'create', calling method: .version_select at 0x7f54b39d7e50>, body: {"keypair": {"name": "tempest-keypair-1733829618", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGmSlAcW3CQbHkELhrLOhi43PiSIb/I4/vb8IkM0wd74PjhxVGVUVby+aSepQ7YR0gsaur2YBpJKE2MCrckvgabpLx3aN0+etGMfbr7A+vM4XzHHK5kp5afdJ6zJ8Hujg=="}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:26:27.584076 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-90cab58b-258b-41ef-ab01-c1a31f283f52 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Getting quotas for project 61eb996219124e819beda67ca498dee8. Resources: {'key_pairs'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:26:27.591023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-90cab58b-258b-41ef-ab01-c1a31f283f52 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Getting quotas for user b9f97f3f5c2e41c69961dafa9bdf84e8 and project 61eb996219124e819beda67ca498dee8. Resources: {'key_pairs'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:26:27.834137 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-47e3d003-4be6-4b07-b772-886cbc01f278 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:27.834900 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-47e3d003-4be6-4b07-b772-886cbc01f278 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:27.850142 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-47e3d003-4be6-4b07-b772-886cbc01f278 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:27.850683 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-47e3d003-4be6-4b07-b772-886cbc01f278 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:27.854688 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-47e3d003-4be6-4b07-b772-886cbc01f278 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:27.855680 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-47e3d003-4be6-4b07-b772-886cbc01f278 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:27.856914 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-47e3d003-4be6-4b07-b772-886cbc01f278 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:27.857583 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-47e3d003-4be6-4b07-b772-886cbc01f278 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:27.868302 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-90cab58b-258b-41ef-ab01-c1a31f283f52 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.465606 Sep 19 12:26:27.869007 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 15/30] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Sep 19 12:26:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:26:28.039182 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-9a11b40b-acf1-40b9-83e4-c4cad38287dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:28.040107 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-9a11b40b-acf1-40b9-83e4-c4cad38287dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:28.047968 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9a11b40b-acf1-40b9-83e4-c4cad38287dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:28.049050 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9a11b40b-acf1-40b9-83e4-c4cad38287dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:28.049878 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9a11b40b-acf1-40b9-83e4-c4cad38287dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:28.051177 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9a11b40b-acf1-40b9-83e4-c4cad38287dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:28.051990 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9a11b40b-acf1-40b9-83e4-c4cad38287dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:28.052701 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9a11b40b-acf1-40b9-83e4-c4cad38287dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:28.237483 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-47e3d003-4be6-4b07-b772-886cbc01f278 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:28.249248 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-47e3d003-4be6-4b07-b772-886cbc01f278 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1272 microversion: 2.1 time: 0.419936 Sep 19 12:26:28.251125 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-9a11b40b-acf1-40b9-83e4-c4cad38287dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:28.251328 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 16/31] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:27 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1272 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:28.267627 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-9a11b40b-acf1-40b9-83e4-c4cad38287dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1225 microversion: 2.1 time: 0.228597 Sep 19 12:26:28.271731 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 16/32] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:28 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1225 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:29.283480 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e6becf46-8d2a-4de1-852a-934a1b233673 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:29.285258 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-e6becf46-8d2a-4de1-852a-934a1b233673 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:29.287608 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=2 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:29.300152 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-24cd88b2-32d1-4628-880f-bd9153b76422 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:29.301529 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-24cd88b2-32d1-4628-880f-bd9153b76422 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:29.310783 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-24cd88b2-32d1-4628-880f-bd9153b76422 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:29.311202 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e6becf46-8d2a-4de1-852a-934a1b233673 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:29.311883 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e6becf46-8d2a-4de1-852a-934a1b233673 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:29.313250 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e6becf46-8d2a-4de1-852a-934a1b233673 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:29.314110 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-24cd88b2-32d1-4628-880f-bd9153b76422 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:29.314744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-24cd88b2-32d1-4628-880f-bd9153b76422 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:29.315856 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e6becf46-8d2a-4de1-852a-934a1b233673 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:29.318648 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-24cd88b2-32d1-4628-880f-bd9153b76422 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:29.320303 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e6becf46-8d2a-4de1-852a-934a1b233673 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:29.321052 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-24cd88b2-32d1-4628-880f-bd9153b76422 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:29.321655 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e6becf46-8d2a-4de1-852a-934a1b233673 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:29.321843 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-24cd88b2-32d1-4628-880f-bd9153b76422 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:29.751344 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-24cd88b2-32d1-4628-880f-bd9153b76422 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:29.770669 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-24cd88b2-32d1-4628-880f-bd9153b76422 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1273 microversion: 2.1 time: 0.475712 Sep 19 12:26:29.797478 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 17/33] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:29 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1273 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:30.437411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e6becf46-8d2a-4de1-852a-934a1b233673 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:30.458444 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e6becf46-8d2a-4de1-852a-934a1b233673 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 1.180639 Sep 19 12:26:30.474435 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 17/34] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:29 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:30.807507 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-0c89c654-6e55-4d29-a173-e001fde6a7a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:30.809633 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-0c89c654-6e55-4d29-a173-e001fde6a7a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:30.860925 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0c89c654-6e55-4d29-a173-e001fde6a7a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:30.862685 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0c89c654-6e55-4d29-a173-e001fde6a7a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:30.875911 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0c89c654-6e55-4d29-a173-e001fde6a7a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:30.876788 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0c89c654-6e55-4d29-a173-e001fde6a7a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:30.877288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0c89c654-6e55-4d29-a173-e001fde6a7a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:30.877733 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0c89c654-6e55-4d29-a173-e001fde6a7a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:31.173852 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-0c89c654-6e55-4d29-a173-e001fde6a7a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:31.199621 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-0c89c654-6e55-4d29-a173-e001fde6a7a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1273 microversion: 2.1 time: 0.399708 Sep 19 12:26:31.212659 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 18/35] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:30 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1273 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:31.502937 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9922ec14-be22-4cfb-9eb3-f4bea2bf5281 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:31.504248 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9922ec14-be22-4cfb-9eb3-f4bea2bf5281 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:31.527488 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9922ec14-be22-4cfb-9eb3-f4bea2bf5281 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:31.528726 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9922ec14-be22-4cfb-9eb3-f4bea2bf5281 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:31.532986 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9922ec14-be22-4cfb-9eb3-f4bea2bf5281 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:31.534222 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9922ec14-be22-4cfb-9eb3-f4bea2bf5281 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:31.536913 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9922ec14-be22-4cfb-9eb3-f4bea2bf5281 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:31.542413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9922ec14-be22-4cfb-9eb3-f4bea2bf5281 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:32.178223 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9922ec14-be22-4cfb-9eb3-f4bea2bf5281 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:32.190478 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9922ec14-be22-4cfb-9eb3-f4bea2bf5281 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 0.690328 Sep 19 12:26:32.195115 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 18/36] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:31 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:32.231260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a54d0134-37be-46c0-bbaf-4043a9f87eca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:32.236089 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a54d0134-37be-46c0-bbaf-4043a9f87eca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:32.250374 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a54d0134-37be-46c0-bbaf-4043a9f87eca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:32.269930 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a54d0134-37be-46c0-bbaf-4043a9f87eca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:32.270436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a54d0134-37be-46c0-bbaf-4043a9f87eca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:32.271155 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a54d0134-37be-46c0-bbaf-4043a9f87eca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:32.271652 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a54d0134-37be-46c0-bbaf-4043a9f87eca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:32.272094 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a54d0134-37be-46c0-bbaf-4043a9f87eca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:32.575940 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-a54d0134-37be-46c0-bbaf-4043a9f87eca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:32.613477 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a54d0134-37be-46c0-bbaf-4043a9f87eca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1279 microversion: 2.1 time: 0.387767 Sep 19 12:26:32.637041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 19/37] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:32 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1279 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:33.217530 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-fc50e1ef-099a-4914-9e6a-c56834f12cee tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:33.218753 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-fc50e1ef-099a-4914-9e6a-c56834f12cee tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:33.229285 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc50e1ef-099a-4914-9e6a-c56834f12cee tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:33.230131 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc50e1ef-099a-4914-9e6a-c56834f12cee tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:33.237541 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc50e1ef-099a-4914-9e6a-c56834f12cee tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:33.238474 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc50e1ef-099a-4914-9e6a-c56834f12cee tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:33.239098 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc50e1ef-099a-4914-9e6a-c56834f12cee tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:33.239726 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc50e1ef-099a-4914-9e6a-c56834f12cee tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:33.642851 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-30f56db5-4c5c-49e6-9b52-7289fe35b130 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:33.649543 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-30f56db5-4c5c-49e6-9b52-7289fe35b130 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:33.666529 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-30f56db5-4c5c-49e6-9b52-7289fe35b130 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:33.667637 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-30f56db5-4c5c-49e6-9b52-7289fe35b130 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:33.673131 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-30f56db5-4c5c-49e6-9b52-7289fe35b130 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:33.676718 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-30f56db5-4c5c-49e6-9b52-7289fe35b130 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:33.677272 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-30f56db5-4c5c-49e6-9b52-7289fe35b130 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:33.678161 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-30f56db5-4c5c-49e6-9b52-7289fe35b130 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:34.082209 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-30f56db5-4c5c-49e6-9b52-7289fe35b130 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:34.103172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-30f56db5-4c5c-49e6-9b52-7289fe35b130 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1279 microversion: 2.1 time: 0.469004 Sep 19 12:26:34.107999 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 20/38] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:33 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1279 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:34.495099 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-fc50e1ef-099a-4914-9e6a-c56834f12cee tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:34.507696 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-fc50e1ef-099a-4914-9e6a-c56834f12cee tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 1.293993 Sep 19 12:26:34.513438 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 19/39] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:33 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:35.133916 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-686bc7b8-a503-47e9-ba3f-91293e793c3b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:35.134544 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-686bc7b8-a503-47e9-ba3f-91293e793c3b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:35.142827 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-686bc7b8-a503-47e9-ba3f-91293e793c3b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:35.144704 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-686bc7b8-a503-47e9-ba3f-91293e793c3b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:35.153250 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-686bc7b8-a503-47e9-ba3f-91293e793c3b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:35.154377 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-686bc7b8-a503-47e9-ba3f-91293e793c3b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:35.156505 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-686bc7b8-a503-47e9-ba3f-91293e793c3b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:35.157172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-686bc7b8-a503-47e9-ba3f-91293e793c3b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:35.535462 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-6b0aaf9b-3611-4d3e-9927-cb70d2e31b33 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:35.536086 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-6b0aaf9b-3611-4d3e-9927-cb70d2e31b33 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:35.552950 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6b0aaf9b-3611-4d3e-9927-cb70d2e31b33 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:35.559392 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6b0aaf9b-3611-4d3e-9927-cb70d2e31b33 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:35.559856 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6b0aaf9b-3611-4d3e-9927-cb70d2e31b33 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:35.565712 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6b0aaf9b-3611-4d3e-9927-cb70d2e31b33 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:35.566208 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6b0aaf9b-3611-4d3e-9927-cb70d2e31b33 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:35.566656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6b0aaf9b-3611-4d3e-9927-cb70d2e31b33 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:35.813782 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=4 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:36.828092 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-686bc7b8-a503-47e9-ba3f-91293e793c3b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:36.837223 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-686bc7b8-a503-47e9-ba3f-91293e793c3b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1321 microversion: 2.1 time: 1.714072 Sep 19 12:26:36.846263 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 21/40] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:35 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1321 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:37.004448 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=20 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:37.133995 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-49dab11a-2688-494d-8cc6-eedc5dc8faee req-69194053-1930-4606-88b5-17857b1d50ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1", "tag": "c0f23c2d-a197-4591-96d2-604617c4253d"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:26:37.170628 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-49dab11a-2688-494d-8cc6-eedc5dc8faee req-69194053-1930-4606-88b5-17857b1d50ea service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:37.171196 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-49dab11a-2688-494d-8cc6-eedc5dc8faee req-69194053-1930-4606-88b5-17857b1d50ea service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:37.176406 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-49dab11a-2688-494d-8cc6-eedc5dc8faee req-69194053-1930-4606-88b5-17857b1d50ea service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:37.230830 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-49dab11a-2688-494d-8cc6-eedc5dc8faee req-69194053-1930-4606-88b5-17857b1d50ea service nova] Creating event network-changed:c0f23c2d-a197-4591-96d2-604617c4253d for instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 on hv-cinder-85061 Sep 19 12:26:37.231756 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-49dab11a-2688-494d-8cc6-eedc5dc8faee req-69194053-1930-4606-88b5-17857b1d50ea service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121428) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 12:26:37.232217 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-49dab11a-2688-494d-8cc6-eedc5dc8faee req-69194053-1930-4606-88b5-17857b1d50ea service nova] Acquired lock "compute-rpcapi-router" {{(pid=121428) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 12:26:37.233840 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-da3ef85c-8f1b-4b78-845a-7a89c63b9808 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:37.234536 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-da3ef85c-8f1b-4b78-845a-7a89c63b9808 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:37.235142 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-da3ef85c-8f1b-4b78-845a-7a89c63b9808 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:37.236033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-da3ef85c-8f1b-4b78-845a-7a89c63b9808 None None] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:37.236851 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-da3ef85c-8f1b-4b78-845a-7a89c63b9808 None None] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:37.245877 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-da3ef85c-8f1b-4b78-845a-7a89c63b9808 None None] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:37.285708 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.compute.rpcapi [None req-da3ef85c-8f1b-4b78-845a-7a89c63b9808 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 19 12:26:37.286869 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-da3ef85c-8f1b-4b78-845a-7a89c63b9808 None None] Releasing lock "compute-rpcapi-router" {{(pid=121428) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 12:26:37.318147 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-da3ef85c-8f1b-4b78-845a-7a89c63b9808 None None] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.470396 Sep 19 12:26:37.324257 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 22/41] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:26:37.414414 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-6b0aaf9b-3611-4d3e-9927-cb70d2e31b33 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:37.445027 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-6b0aaf9b-3611-4d3e-9927-cb70d2e31b33 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 1.912095 Sep 19 12:26:37.446959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 20/42] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:35 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:37.886527 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=16 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:37.891444 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-64e6a30d-568e-4834-b3d3-aae9ed92bf8e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:37.892684 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-64e6a30d-568e-4834-b3d3-aae9ed92bf8e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:37.906684 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-64e6a30d-568e-4834-b3d3-aae9ed92bf8e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:37.907442 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-64e6a30d-568e-4834-b3d3-aae9ed92bf8e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:37.908023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-64e6a30d-568e-4834-b3d3-aae9ed92bf8e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:37.909040 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-64e6a30d-568e-4834-b3d3-aae9ed92bf8e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:37.909641 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-64e6a30d-568e-4834-b3d3-aae9ed92bf8e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:37.911458 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-64e6a30d-568e-4834-b3d3-aae9ed92bf8e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:38.469988 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5d9e6437-f726-480e-99fb-e64d0b703ccd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:38.471586 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-5d9e6437-f726-480e-99fb-e64d0b703ccd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:38.483311 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:38.493790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5d9e6437-f726-480e-99fb-e64d0b703ccd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:38.494625 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5d9e6437-f726-480e-99fb-e64d0b703ccd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:38.496700 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5d9e6437-f726-480e-99fb-e64d0b703ccd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:38.499087 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5d9e6437-f726-480e-99fb-e64d0b703ccd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:38.499815 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5d9e6437-f726-480e-99fb-e64d0b703ccd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:38.502047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5d9e6437-f726-480e-99fb-e64d0b703ccd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:39.106371 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-64e6a30d-568e-4834-b3d3-aae9ed92bf8e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:39.117592 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-5d9e6437-f726-480e-99fb-e64d0b703ccd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:39.137849 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5d9e6437-f726-480e-99fb-e64d0b703ccd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 0.672258 Sep 19 12:26:39.138782 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 21/43] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:38 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:39.145545 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-648a081c-25fd-4ce4-99ab-fe7b34a041a1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1552262159", "imageRef": "d4301833-8e96-46bf-a940-692f93f7fdba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2775bc2c-1de6-4530-99c8-74593487735c"}], "security_groups": [{"name": "tempest-securitygroup--1098874897"}], "key_name": "tempest-keypair-322976130", "user_data": "}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:26:39.172721 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-64e6a30d-568e-4834-b3d3-aae9ed92bf8e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1321 microversion: 2.1 time: 1.278567 Sep 19 12:26:39.173530 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 23/44] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:37 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1321 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:39.596819 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.network.neutron [None req-648a081c-25fd-4ce4-99ab-fe7b34a041a1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] validate_networks() for [('2775bc2c-1de6-4530-99c8-74593487735c', None, None, None, None, None)] {{(pid=121429) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:26:40.246694 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-d68a1c94-77ce-4a86-bbec-1799474dda8d req-2d05b42c-2817-4547-988b-1478b9d57e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa0ab2f3-883e-4b45-95d1-d0f8895fc401", "tag": "bfac18c5-608d-4385-8ac9-7abf25bb62fe"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:26:40.275730 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-d68a1c94-77ce-4a86-bbec-1799474dda8d req-2d05b42c-2817-4547-988b-1478b9d57e10 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:40.277357 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-d68a1c94-77ce-4a86-bbec-1799474dda8d req-2d05b42c-2817-4547-988b-1478b9d57e10 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:40.278900 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-d68a1c94-77ce-4a86-bbec-1799474dda8d req-2d05b42c-2817-4547-988b-1478b9d57e10 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:40.314889 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-d68a1c94-77ce-4a86-bbec-1799474dda8d req-2d05b42c-2817-4547-988b-1478b9d57e10 service nova] Creating event network-changed:bfac18c5-608d-4385-8ac9-7abf25bb62fe for instance aa0ab2f3-883e-4b45-95d1-d0f8895fc401 on hv-cinder-85061 Sep 19 12:26:40.328856 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-d68a1c94-77ce-4a86-bbec-1799474dda8d req-2d05b42c-2817-4547-988b-1478b9d57e10 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.933179 Sep 19 12:26:40.330116 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 24/45] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:26:40.348721 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-6ab2d114-03e4-4cf4-bf80-1aca1b6e0a10 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1911996234", "imageRef": "d4301833-8e96-46bf-a940-692f93f7fdba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd198206-8f2d-4496-8d28-135d50c06a18"}], "security_groups": [{"name": "tempest-securitygroup--49619042"}], "key_name": "tempest-keypair-1733829618", "user_data": "}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:26:40.681760 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.network.neutron [None req-6ab2d114-03e4-4cf4-bf80-1aca1b6e0a10 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] validate_networks() for [('fd198206-8f2d-4496-8d28-135d50c06a18', None, None, None, None, None)] {{(pid=121428) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:26:42.304445 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-6ab2d114-03e4-4cf4-bf80-1aca1b6e0a10 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Flavor limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:26:42.305696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-6ab2d114-03e4-4cf4-bf80-1aca1b6e0a10 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Image limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:26:42.306196 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-6ab2d114-03e4-4cf4-bf80-1aca1b6e0a10 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Flavor pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:26:42.306776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-6ab2d114-03e4-4cf4-bf80-1aca1b6e0a10 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Image pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:26:42.307330 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-6ab2d114-03e4-4cf4-bf80-1aca1b6e0a10 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:26:42.325581 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6ab2d114-03e4-4cf4-bf80-1aca1b6e0a10 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:42.326548 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6ab2d114-03e4-4cf4-bf80-1aca1b6e0a10 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:42.327599 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6ab2d114-03e4-4cf4-bf80-1aca1b6e0a10 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:42.329068 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6ab2d114-03e4-4cf4-bf80-1aca1b6e0a10 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:42.330024 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6ab2d114-03e4-4cf4-bf80-1aca1b6e0a10 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:42.331064 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6ab2d114-03e4-4cf4-bf80-1aca1b6e0a10 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:42.363323 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-6ab2d114-03e4-4cf4-bf80-1aca1b6e0a10 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Getting quotas for project 61eb996219124e819beda67ca498dee8. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:26:42.372707 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-6ab2d114-03e4-4cf4-bf80-1aca1b6e0a10 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Getting quotas for user b9f97f3f5c2e41c69961dafa9bdf84e8 and project 61eb996219124e819beda67ca498dee8. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:26:42.392515 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6ab2d114-03e4-4cf4-bf80-1aca1b6e0a10 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Going to run 1 instances... {{(pid=121428) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:26:42.397241 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6ab2d114-03e4-4cf4-bf80-1aca1b6e0a10 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4301833-8e96-46bf-a940-692f93f7fdba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:26:42.659559 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-648a081c-25fd-4ce4-99ab-fe7b34a041a1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Flavor limits 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:26:42.660074 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-648a081c-25fd-4ce4-99ab-fe7b34a041a1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Image limits 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:26:42.660697 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-648a081c-25fd-4ce4-99ab-fe7b34a041a1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Flavor pref 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:26:42.661120 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-648a081c-25fd-4ce4-99ab-fe7b34a041a1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Image pref 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:26:42.661759 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-648a081c-25fd-4ce4-99ab-fe7b34a041a1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:26:42.701551 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-648a081c-25fd-4ce4-99ab-fe7b34a041a1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:42.702300 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-648a081c-25fd-4ce4-99ab-fe7b34a041a1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:42.702745 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-648a081c-25fd-4ce4-99ab-fe7b34a041a1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:42.703515 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-648a081c-25fd-4ce4-99ab-fe7b34a041a1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:42.704167 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-648a081c-25fd-4ce4-99ab-fe7b34a041a1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:42.704378 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-648a081c-25fd-4ce4-99ab-fe7b34a041a1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:42.714442 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-6ab2d114-03e4-4cf4-bf80-1aca1b6e0a10 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.382629 Sep 19 12:26:42.715270 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 25/46] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:26:40 2022] POST /compute/v2.1/servers => generated 400 bytes in 2384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:26:42.722651 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-983b16a7-a543-4523-ad0d-eacb22c2706d tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:42.722651 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-983b16a7-a543-4523-ad0d-eacb22c2706d tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:42.767521 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-983b16a7-a543-4523-ad0d-eacb22c2706d tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:42.768032 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-983b16a7-a543-4523-ad0d-eacb22c2706d tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:42.768473 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-983b16a7-a543-4523-ad0d-eacb22c2706d tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:42.774393 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-983b16a7-a543-4523-ad0d-eacb22c2706d tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:42.775462 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-648a081c-25fd-4ce4-99ab-fe7b34a041a1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Getting quotas for project 68496d9aa29542139f00104051248a5b. Resources: {'instances', 'ram', 'cores'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:26:42.777704 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-983b16a7-a543-4523-ad0d-eacb22c2706d tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:42.778214 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-983b16a7-a543-4523-ad0d-eacb22c2706d tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:42.789467 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-648a081c-25fd-4ce4-99ab-fe7b34a041a1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Getting quotas for user 3a48e0ab477f43d294607d441af0b444 and project 68496d9aa29542139f00104051248a5b. Resources: {'instances', 'ram', 'cores'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:26:42.823653 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-648a081c-25fd-4ce4-99ab-fe7b34a041a1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Going to run 1 instances... {{(pid=121429) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:26:42.826113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-648a081c-25fd-4ce4-99ab-fe7b34a041a1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4301833-8e96-46bf-a940-692f93f7fdba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121429) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:26:43.190409 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-648a081c-25fd-4ce4-99ab-fe7b34a041a1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.050263 Sep 19 12:26:43.196041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 22/47] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:26:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 4056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:26:43.210705 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-798be95f-76cd-4476-bbd2-df739ee640bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:43.211611 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-798be95f-76cd-4476-bbd2-df739ee640bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:43.220272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-798be95f-76cd-4476-bbd2-df739ee640bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:43.220799 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-798be95f-76cd-4476-bbd2-df739ee640bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:43.222178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-798be95f-76cd-4476-bbd2-df739ee640bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:43.223932 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-798be95f-76cd-4476-bbd2-df739ee640bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:43.224540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-798be95f-76cd-4476-bbd2-df739ee640bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:43.225571 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-798be95f-76cd-4476-bbd2-df739ee640bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:43.325872 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-983b16a7-a543-4523-ad0d-eacb22c2706d tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:43.338968 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-983b16a7-a543-4523-ad0d-eacb22c2706d tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 0.622565 Sep 19 12:26:43.350982 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 26/48] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:42 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:43.373970 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-a2373c87-9df7-4492-8ea4-f7e44829cf96 req-d8d3e865-df42-4217-a08a-5a556c8e70af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c3ee0aa-80a4-4587-a3dc-c9f654af3edc", "tag": "407a25f0-769d-4a17-9669-56cf43a8cdc3"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:26:43.399425 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-a2373c87-9df7-4492-8ea4-f7e44829cf96 req-d8d3e865-df42-4217-a08a-5a556c8e70af service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:43.399804 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-a2373c87-9df7-4492-8ea4-f7e44829cf96 req-d8d3e865-df42-4217-a08a-5a556c8e70af service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:43.400248 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-a2373c87-9df7-4492-8ea4-f7e44829cf96 req-d8d3e865-df42-4217-a08a-5a556c8e70af service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:43.426646 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-a2373c87-9df7-4492-8ea4-f7e44829cf96 req-d8d3e865-df42-4217-a08a-5a556c8e70af service nova] Creating event network-changed:407a25f0-769d-4a17-9669-56cf43a8cdc3 for instance 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc on hv-cinder-85061 Sep 19 12:26:43.432900 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-a2373c87-9df7-4492-8ea4-f7e44829cf96 req-d8d3e865-df42-4217-a08a-5a556c8e70af service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071317 Sep 19 12:26:43.451025 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 27/49] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:26:43.458931 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d7e7248c-30ab-4e0a-9249-83712c15d342 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:43.469816 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d7e7248c-30ab-4e0a-9249-83712c15d342 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:43.492830 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-798be95f-76cd-4476-bbd2-df739ee640bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:43.505693 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-798be95f-76cd-4476-bbd2-df739ee640bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1321 microversion: 2.1 time: 0.307322 Sep 19 12:26:43.507871 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 23/50] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:43 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1321 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:43.515242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-bb8b3bd6-3be0-4882-90f9-e4f4ae2a6558 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:43.516251 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-bb8b3bd6-3be0-4882-90f9-e4f4ae2a6558 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:43.653239 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-bb8b3bd6-3be0-4882-90f9-e4f4ae2a6558 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:43.666737 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-bb8b3bd6-3be0-4882-90f9-e4f4ae2a6558 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1241 microversion: 2.1 time: 0.156804 Sep 19 12:26:43.682226 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 24/51] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:43 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1241 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:43.691779 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-d7e7248c-30ab-4e0a-9249-83712c15d342 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:43.722534 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d7e7248c-30ab-4e0a-9249-83712c15d342 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1238 microversion: 2.1 time: 0.270022 Sep 19 12:26:43.731408 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 28/52] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:43 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1238 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:44.375173 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-a259fc31-79fc-43a4-b938-4b4adba3c55c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:44.375842 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-a259fc31-79fc-43a4-b938-4b4adba3c55c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:44.385904 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a259fc31-79fc-43a4-b938-4b4adba3c55c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:44.387384 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a259fc31-79fc-43a4-b938-4b4adba3c55c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:44.387879 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a259fc31-79fc-43a4-b938-4b4adba3c55c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:44.398346 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a259fc31-79fc-43a4-b938-4b4adba3c55c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:44.399599 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a259fc31-79fc-43a4-b938-4b4adba3c55c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:44.400048 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a259fc31-79fc-43a4-b938-4b4adba3c55c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:44.538390 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-7cdadfef-1f62-4ace-8e3c-db61ff5c2d30 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:44.539191 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-7cdadfef-1f62-4ace-8e3c-db61ff5c2d30 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:44.554182 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7cdadfef-1f62-4ace-8e3c-db61ff5c2d30 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:44.554953 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7cdadfef-1f62-4ace-8e3c-db61ff5c2d30 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:44.555623 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7cdadfef-1f62-4ace-8e3c-db61ff5c2d30 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:44.556492 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7cdadfef-1f62-4ace-8e3c-db61ff5c2d30 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:44.557122 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7cdadfef-1f62-4ace-8e3c-db61ff5c2d30 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:44.557537 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7cdadfef-1f62-4ace-8e3c-db61ff5c2d30 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:44.564954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-a259fc31-79fc-43a4-b938-4b4adba3c55c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:44.573669 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-a259fc31-79fc-43a4-b938-4b4adba3c55c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 0.203211 Sep 19 12:26:44.574437 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 25/53] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:44 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:44.697281 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e309576f-05ed-42d9-928f-d9218ef36a1a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:44.698832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-e309576f-05ed-42d9-928f-d9218ef36a1a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:44.722134 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-7cdadfef-1f62-4ace-8e3c-db61ff5c2d30 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:44.731634 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-7cdadfef-1f62-4ace-8e3c-db61ff5c2d30 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1321 microversion: 2.1 time: 0.197020 Sep 19 12:26:44.732217 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 29/54] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:44 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:44.759694 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-5adee440-9b32-4a21-9ffb-407841adb94e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:44.760075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e309576f-05ed-42d9-928f-d9218ef36a1a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:44.761099 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-5adee440-9b32-4a21-9ffb-407841adb94e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:44.768750 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e309576f-05ed-42d9-928f-d9218ef36a1a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1241 microversion: 2.1 time: 0.077709 Sep 19 12:26:44.776642 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 26/55] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:44 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:44.815211 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5adee440-9b32-4a21-9ffb-407841adb94e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:44.831686 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-5adee440-9b32-4a21-9ffb-407841adb94e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1238 microversion: 2.1 time: 0.069388 Sep 19 12:26:44.831686 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 30/56] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:44 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:45.597743 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-37c7e395-aab1-4cb3-8a36-15c1e0241a77 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:45.598413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-37c7e395-aab1-4cb3-8a36-15c1e0241a77 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:45.605511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-37c7e395-aab1-4cb3-8a36-15c1e0241a77 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:45.606137 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-37c7e395-aab1-4cb3-8a36-15c1e0241a77 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:45.606794 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-37c7e395-aab1-4cb3-8a36-15c1e0241a77 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:45.607511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-37c7e395-aab1-4cb3-8a36-15c1e0241a77 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:45.607963 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-37c7e395-aab1-4cb3-8a36-15c1e0241a77 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:45.608382 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-37c7e395-aab1-4cb3-8a36-15c1e0241a77 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:45.778160 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f406c4d1-54b4-4139-893e-81b4cee049a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:45.778160 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f406c4d1-54b4-4139-893e-81b4cee049a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:45.778160 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:45.778811 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-37c7e395-aab1-4cb3-8a36-15c1e0241a77 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:45.779162 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f406c4d1-54b4-4139-893e-81b4cee049a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:45.779162 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f406c4d1-54b4-4139-893e-81b4cee049a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:45.779162 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f406c4d1-54b4-4139-893e-81b4cee049a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:45.779162 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f406c4d1-54b4-4139-893e-81b4cee049a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:45.779424 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f406c4d1-54b4-4139-893e-81b4cee049a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:45.779424 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f406c4d1-54b4-4139-893e-81b4cee049a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:45.780531 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-37c7e395-aab1-4cb3-8a36-15c1e0241a77 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 0.186840 Sep 19 12:26:45.780955 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 27/57] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:45 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:45.799570 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=75 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:45.801534 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-85570970-50ec-4583-93ea-245caeed2552 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:45.802396 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-85570970-50ec-4583-93ea-245caeed2552 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:45.811855 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-85570970-50ec-4583-93ea-245caeed2552 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:45.812763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-85570970-50ec-4583-93ea-245caeed2552 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:45.813616 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-85570970-50ec-4583-93ea-245caeed2552 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:45.814904 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-85570970-50ec-4583-93ea-245caeed2552 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:45.816184 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-85570970-50ec-4583-93ea-245caeed2552 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:45.816904 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-85570970-50ec-4583-93ea-245caeed2552 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:45.926731 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-85570970-50ec-4583-93ea-245caeed2552 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:45.935378 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-85570970-50ec-4583-93ea-245caeed2552 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1245 microversion: 2.1 time: 0.140707 Sep 19 12:26:45.936694 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 28/58] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:45 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1245 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:45.942930 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-0cb81dd0-1832-4ecc-83cd-20ce7ba5464a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:45.944586 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-0cb81dd0-1832-4ecc-83cd-20ce7ba5464a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:45.951435 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0cb81dd0-1832-4ecc-83cd-20ce7ba5464a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:45.952238 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0cb81dd0-1832-4ecc-83cd-20ce7ba5464a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:45.952768 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0cb81dd0-1832-4ecc-83cd-20ce7ba5464a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:45.953668 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0cb81dd0-1832-4ecc-83cd-20ce7ba5464a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:45.954295 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0cb81dd0-1832-4ecc-83cd-20ce7ba5464a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:45.954604 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f406c4d1-54b4-4139-893e-81b4cee049a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:45.955121 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0cb81dd0-1832-4ecc-83cd-20ce7ba5464a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:45.972473 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f406c4d1-54b4-4139-893e-81b4cee049a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1321 microversion: 2.1 time: 0.220300 Sep 19 12:26:45.984623 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 31/59] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:45 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:46.031632 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-0cb81dd0-1832-4ecc-83cd-20ce7ba5464a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:46.037200 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-0cb81dd0-1832-4ecc-83cd-20ce7ba5464a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1242 microversion: 2.1 time: 0.099143 Sep 19 12:26:46.044973 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 29/60] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:45 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:46.805649 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-1656fd2c-5cf7-437f-9707-5994c8318235 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:46.806261 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-1656fd2c-5cf7-437f-9707-5994c8318235 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:46.812297 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1656fd2c-5cf7-437f-9707-5994c8318235 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:46.812842 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1656fd2c-5cf7-437f-9707-5994c8318235 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:46.813279 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1656fd2c-5cf7-437f-9707-5994c8318235 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:46.813968 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1656fd2c-5cf7-437f-9707-5994c8318235 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:46.814414 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1656fd2c-5cf7-437f-9707-5994c8318235 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:46.814842 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1656fd2c-5cf7-437f-9707-5994c8318235 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:46.951749 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-1656fd2c-5cf7-437f-9707-5994c8318235 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:46.959711 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-d743f066-9f64-4ee3-9950-d5b8ed2f5d0e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:46.960257 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-1656fd2c-5cf7-437f-9707-5994c8318235 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 0.157604 Sep 19 12:26:46.960461 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 32/61] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:46 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:46.961222 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-d743f066-9f64-4ee3-9950-d5b8ed2f5d0e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:46.967113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d743f066-9f64-4ee3-9950-d5b8ed2f5d0e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:46.967587 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d743f066-9f64-4ee3-9950-d5b8ed2f5d0e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:46.968014 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d743f066-9f64-4ee3-9950-d5b8ed2f5d0e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:46.968955 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d743f066-9f64-4ee3-9950-d5b8ed2f5d0e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:46.969405 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d743f066-9f64-4ee3-9950-d5b8ed2f5d0e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:46.969822 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d743f066-9f64-4ee3-9950-d5b8ed2f5d0e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:46.997330 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-dd19119f-3fe9-4c5c-a346-fb5728ccd766 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:46.998380 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-dd19119f-3fe9-4c5c-a346-fb5728ccd766 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:47.004382 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dd19119f-3fe9-4c5c-a346-fb5728ccd766 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:47.005000 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dd19119f-3fe9-4c5c-a346-fb5728ccd766 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:47.005498 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dd19119f-3fe9-4c5c-a346-fb5728ccd766 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:47.006299 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dd19119f-3fe9-4c5c-a346-fb5728ccd766 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:47.006807 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dd19119f-3fe9-4c5c-a346-fb5728ccd766 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:47.007331 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dd19119f-3fe9-4c5c-a346-fb5728ccd766 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:47.043323 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-d743f066-9f64-4ee3-9950-d5b8ed2f5d0e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:47.051108 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-d743f066-9f64-4ee3-9950-d5b8ed2f5d0e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1245 microversion: 2.1 time: 0.095666 Sep 19 12:26:47.051692 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 30/62] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:46 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:47.062762 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-dfb1bff2-078b-4746-b59d-3a0bf6b46e89 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:47.063366 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-dfb1bff2-078b-4746-b59d-3a0bf6b46e89 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:47.070980 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dfb1bff2-078b-4746-b59d-3a0bf6b46e89 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:47.071395 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dfb1bff2-078b-4746-b59d-3a0bf6b46e89 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:47.073074 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dfb1bff2-078b-4746-b59d-3a0bf6b46e89 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:47.073861 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dfb1bff2-078b-4746-b59d-3a0bf6b46e89 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:47.074311 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dfb1bff2-078b-4746-b59d-3a0bf6b46e89 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:47.074740 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dfb1bff2-078b-4746-b59d-3a0bf6b46e89 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:47.156712 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-dfb1bff2-078b-4746-b59d-3a0bf6b46e89 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:47.164507 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-dfb1bff2-078b-4746-b59d-3a0bf6b46e89 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1242 microversion: 2.1 time: 0.105710 Sep 19 12:26:47.165128 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 31/63] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:47 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:47.175523 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-dd19119f-3fe9-4c5c-a346-fb5728ccd766 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:47.180937 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-dd19119f-3fe9-4c5c-a346-fb5728ccd766 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1321 microversion: 2.1 time: 0.187585 Sep 19 12:26:47.181509 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 33/64] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:46 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:47.983313 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-8756c165-6158-47a9-9ff2-43c674b1f33c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:47.984010 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-8756c165-6158-47a9-9ff2-43c674b1f33c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:47.990071 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8756c165-6158-47a9-9ff2-43c674b1f33c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:47.991140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8756c165-6158-47a9-9ff2-43c674b1f33c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:47.991659 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8756c165-6158-47a9-9ff2-43c674b1f33c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:47.992495 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8756c165-6158-47a9-9ff2-43c674b1f33c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:47.993044 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8756c165-6158-47a9-9ff2-43c674b1f33c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:47.993530 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8756c165-6158-47a9-9ff2-43c674b1f33c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:48.074986 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-df762910-15e3-4ae7-bde8-6e2d19e47f11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:48.075637 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-df762910-15e3-4ae7-bde8-6e2d19e47f11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:48.082965 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-df762910-15e3-4ae7-bde8-6e2d19e47f11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:48.083447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-df762910-15e3-4ae7-bde8-6e2d19e47f11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:48.083881 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-df762910-15e3-4ae7-bde8-6e2d19e47f11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:48.084648 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-df762910-15e3-4ae7-bde8-6e2d19e47f11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:48.085102 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-df762910-15e3-4ae7-bde8-6e2d19e47f11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:48.085527 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-df762910-15e3-4ae7-bde8-6e2d19e47f11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:48.125574 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8756c165-6158-47a9-9ff2-43c674b1f33c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:48.130486 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=100 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:48.135398 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-8756c165-6158-47a9-9ff2-43c674b1f33c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 0.155952 Sep 19 12:26:48.141180 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 32/65] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:47 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:48.152845 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-df762910-15e3-4ae7-bde8-6e2d19e47f11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:48.160850 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-df762910-15e3-4ae7-bde8-6e2d19e47f11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1245 microversion: 2.1 time: 0.090574 Sep 19 12:26:48.171697 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 34/66] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:48 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:48.188164 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-0b148eec-939d-4b1c-b518-8e2ef1c98904 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:48.188821 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-0b148eec-939d-4b1c-b518-8e2ef1c98904 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:48.195034 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0b148eec-939d-4b1c-b518-8e2ef1c98904 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:48.195518 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0b148eec-939d-4b1c-b518-8e2ef1c98904 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:48.195950 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0b148eec-939d-4b1c-b518-8e2ef1c98904 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:48.196743 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0b148eec-939d-4b1c-b518-8e2ef1c98904 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:48.197190 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0b148eec-939d-4b1c-b518-8e2ef1c98904 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:48.197607 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0b148eec-939d-4b1c-b518-8e2ef1c98904 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:48.204872 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-4cd67781-b920-4157-8a83-e8e12b5756d9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:48.205479 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-4cd67781-b920-4157-8a83-e8e12b5756d9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:48.212002 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4cd67781-b920-4157-8a83-e8e12b5756d9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:48.212511 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4cd67781-b920-4157-8a83-e8e12b5756d9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:48.212997 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4cd67781-b920-4157-8a83-e8e12b5756d9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:48.213695 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4cd67781-b920-4157-8a83-e8e12b5756d9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:48.214139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4cd67781-b920-4157-8a83-e8e12b5756d9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:48.214558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4cd67781-b920-4157-8a83-e8e12b5756d9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:48.276331 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-0b148eec-939d-4b1c-b518-8e2ef1c98904 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:48.287896 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-0b148eec-939d-4b1c-b518-8e2ef1c98904 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1234 microversion: 2.1 time: 0.102954 Sep 19 12:26:48.290251 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 33/67] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:48 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1234 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:48.415624 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-4cd67781-b920-4157-8a83-e8e12b5756d9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:48.426366 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-4cd67781-b920-4157-8a83-e8e12b5756d9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1321 microversion: 2.1 time: 0.225267 Sep 19 12:26:48.427210 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 35/68] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:48 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:49.159040 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2a54d55d-62bd-40c0-9a40-2edbad9d783c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:49.159666 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2a54d55d-62bd-40c0-9a40-2edbad9d783c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:49.166811 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2a54d55d-62bd-40c0-9a40-2edbad9d783c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:49.167305 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2a54d55d-62bd-40c0-9a40-2edbad9d783c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:49.167737 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2a54d55d-62bd-40c0-9a40-2edbad9d783c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:49.179583 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2a54d55d-62bd-40c0-9a40-2edbad9d783c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:49.185812 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2a54d55d-62bd-40c0-9a40-2edbad9d783c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:49.186543 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2a54d55d-62bd-40c0-9a40-2edbad9d783c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:49.195390 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a235f204-c7ed-41b9-8447-81c3cb6f3dca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:49.207127 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a235f204-c7ed-41b9-8447-81c3cb6f3dca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:49.233707 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a235f204-c7ed-41b9-8447-81c3cb6f3dca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:49.234210 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a235f204-c7ed-41b9-8447-81c3cb6f3dca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:49.234655 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a235f204-c7ed-41b9-8447-81c3cb6f3dca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:49.235371 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a235f204-c7ed-41b9-8447-81c3cb6f3dca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:49.235834 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a235f204-c7ed-41b9-8447-81c3cb6f3dca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:49.236262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a235f204-c7ed-41b9-8447-81c3cb6f3dca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:49.387284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-a235f204-c7ed-41b9-8447-81c3cb6f3dca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:49.397758 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a235f204-c7ed-41b9-8447-81c3cb6f3dca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1237 microversion: 2.1 time: 0.216879 Sep 19 12:26:49.404893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 36/69] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:49 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1237 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:49.409814 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ec1665cf-d91b-44e9-b3c6-82a7bbcd1a68 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:49.415904 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-ec1665cf-d91b-44e9-b3c6-82a7bbcd1a68 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:49.418957 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2a54d55d-62bd-40c0-9a40-2edbad9d783c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:49.428591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ec1665cf-d91b-44e9-b3c6-82a7bbcd1a68 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:49.429237 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ec1665cf-d91b-44e9-b3c6-82a7bbcd1a68 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:49.429756 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ec1665cf-d91b-44e9-b3c6-82a7bbcd1a68 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:49.430624 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ec1665cf-d91b-44e9-b3c6-82a7bbcd1a68 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:49.430844 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2a54d55d-62bd-40c0-9a40-2edbad9d783c tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 0.275763 Sep 19 12:26:49.431136 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ec1665cf-d91b-44e9-b3c6-82a7bbcd1a68 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:49.431434 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 34/70] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:49 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:49.431564 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ec1665cf-d91b-44e9-b3c6-82a7bbcd1a68 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:49.454060 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e7698114-41cd-4320-a826-401ddb5d889c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:49.464846 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-e7698114-41cd-4320-a826-401ddb5d889c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:49.488441 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e7698114-41cd-4320-a826-401ddb5d889c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:49.489124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e7698114-41cd-4320-a826-401ddb5d889c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:49.489625 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e7698114-41cd-4320-a826-401ddb5d889c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:49.490441 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e7698114-41cd-4320-a826-401ddb5d889c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:49.490952 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e7698114-41cd-4320-a826-401ddb5d889c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:49.491674 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e7698114-41cd-4320-a826-401ddb5d889c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:49.515704 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-ec1665cf-d91b-44e9-b3c6-82a7bbcd1a68 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:49.532639 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ec1665cf-d91b-44e9-b3c6-82a7bbcd1a68 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1290 microversion: 2.1 time: 0.126008 Sep 19 12:26:49.534185 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 37/71] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:49 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1290 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:49.667564 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e7698114-41cd-4320-a826-401ddb5d889c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:49.676519 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e7698114-41cd-4320-a826-401ddb5d889c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1321 microversion: 2.1 time: 0.228872 Sep 19 12:26:49.677156 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 35/72] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:49 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:50.434441 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ab5fa192-f682-4dcc-8482-12c95ae5f54e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:50.435057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-ab5fa192-f682-4dcc-8482-12c95ae5f54e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:50.441396 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ab5fa192-f682-4dcc-8482-12c95ae5f54e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:50.441883 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ab5fa192-f682-4dcc-8482-12c95ae5f54e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:50.442315 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ab5fa192-f682-4dcc-8482-12c95ae5f54e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:50.443008 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ab5fa192-f682-4dcc-8482-12c95ae5f54e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:50.443536 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ab5fa192-f682-4dcc-8482-12c95ae5f54e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:50.443960 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ab5fa192-f682-4dcc-8482-12c95ae5f54e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:50.455508 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e67308d8-107d-44ab-8a1d-08ea1f3b7f91 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:50.459006 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-e67308d8-107d-44ab-8a1d-08ea1f3b7f91 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:50.463640 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e67308d8-107d-44ab-8a1d-08ea1f3b7f91 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:50.464205 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e67308d8-107d-44ab-8a1d-08ea1f3b7f91 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:50.465355 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e67308d8-107d-44ab-8a1d-08ea1f3b7f91 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:50.465578 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e67308d8-107d-44ab-8a1d-08ea1f3b7f91 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:50.466141 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e67308d8-107d-44ab-8a1d-08ea1f3b7f91 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:50.466641 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e67308d8-107d-44ab-8a1d-08ea1f3b7f91 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:50.515833 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-ab5fa192-f682-4dcc-8482-12c95ae5f54e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:50.525026 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ab5fa192-f682-4dcc-8482-12c95ae5f54e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1293 microversion: 2.1 time: 0.094420 Sep 19 12:26:50.526006 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 38/73] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:50 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:50.557984 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ae771519-d211-41b4-ae14-62ae8553a1c4 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:50.558589 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-ae771519-d211-41b4-ae14-62ae8553a1c4 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:50.564511 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ae771519-d211-41b4-ae14-62ae8553a1c4 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:50.565027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ae771519-d211-41b4-ae14-62ae8553a1c4 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:50.565454 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ae771519-d211-41b4-ae14-62ae8553a1c4 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:50.566135 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ae771519-d211-41b4-ae14-62ae8553a1c4 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:50.566581 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ae771519-d211-41b4-ae14-62ae8553a1c4 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:50.566991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ae771519-d211-41b4-ae14-62ae8553a1c4 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:50.646031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-ae771519-d211-41b4-ae14-62ae8553a1c4 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:50.649094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e67308d8-107d-44ab-8a1d-08ea1f3b7f91 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:50.654386 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ae771519-d211-41b4-ae14-62ae8553a1c4 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1298 microversion: 2.1 time: 0.100613 Sep 19 12:26:50.654966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 39/74] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:50 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1298 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:50.656648 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e67308d8-107d-44ab-8a1d-08ea1f3b7f91 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 0.205109 Sep 19 12:26:50.657237 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 36/75] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:50 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:50.700555 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-dee86978-ea26-4d79-bdf7-62b45fde7415 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:50.701115 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-dee86978-ea26-4d79-bdf7-62b45fde7415 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:50.707214 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dee86978-ea26-4d79-bdf7-62b45fde7415 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:50.707700 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dee86978-ea26-4d79-bdf7-62b45fde7415 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:50.708143 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dee86978-ea26-4d79-bdf7-62b45fde7415 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:50.708872 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dee86978-ea26-4d79-bdf7-62b45fde7415 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:50.709823 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dee86978-ea26-4d79-bdf7-62b45fde7415 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:50.710248 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dee86978-ea26-4d79-bdf7-62b45fde7415 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:50.849434 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-dee86978-ea26-4d79-bdf7-62b45fde7415 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:50.858561 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-dee86978-ea26-4d79-bdf7-62b45fde7415 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1321 microversion: 2.1 time: 0.162016 Sep 19 12:26:50.859149 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 40/76] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:50 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:51.556786 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b59bc1be-f678-44be-8bcd-dc996c235594 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:51.558816 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b59bc1be-f678-44be-8bcd-dc996c235594 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:51.565547 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b59bc1be-f678-44be-8bcd-dc996c235594 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:51.569195 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b59bc1be-f678-44be-8bcd-dc996c235594 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:51.569195 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b59bc1be-f678-44be-8bcd-dc996c235594 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:51.569195 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b59bc1be-f678-44be-8bcd-dc996c235594 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:51.569195 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b59bc1be-f678-44be-8bcd-dc996c235594 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:51.569579 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b59bc1be-f678-44be-8bcd-dc996c235594 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:51.676960 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-b59bc1be-f678-44be-8bcd-dc996c235594 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:51.682993 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-4d2f36c9-f7e0-43b4-be15-3fc479e05ea0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:51.684527 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-4d2f36c9-f7e0-43b4-be15-3fc479e05ea0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:51.696810 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-b59bc1be-f678-44be-8bcd-dc996c235594 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1293 microversion: 2.1 time: 0.143063 Sep 19 12:26:51.697645 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 37/77] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:51 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1293 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:51.700630 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4d2f36c9-f7e0-43b4-be15-3fc479e05ea0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:51.703007 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4d2f36c9-f7e0-43b4-be15-3fc479e05ea0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:51.703447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4d2f36c9-f7e0-43b4-be15-3fc479e05ea0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:51.704163 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4d2f36c9-f7e0-43b4-be15-3fc479e05ea0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:51.706717 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4d2f36c9-f7e0-43b4-be15-3fc479e05ea0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:51.707143 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4d2f36c9-f7e0-43b4-be15-3fc479e05ea0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:51.713808 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-429a360f-b771-4de8-ba8f-0db575fe4d3b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:51.714775 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-429a360f-b771-4de8-ba8f-0db575fe4d3b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:51.750949 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-429a360f-b771-4de8-ba8f-0db575fe4d3b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:51.751988 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-429a360f-b771-4de8-ba8f-0db575fe4d3b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:51.752945 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-429a360f-b771-4de8-ba8f-0db575fe4d3b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:51.753991 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-429a360f-b771-4de8-ba8f-0db575fe4d3b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:51.754777 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-429a360f-b771-4de8-ba8f-0db575fe4d3b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:51.766401 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-429a360f-b771-4de8-ba8f-0db575fe4d3b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:52.242148 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-4d2f36c9-f7e0-43b4-be15-3fc479e05ea0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:52.253055 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-4d2f36c9-f7e0-43b4-be15-3fc479e05ea0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1374 microversion: 2.1 time: 0.577161 Sep 19 12:26:52.255868 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 41/78] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:51 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1374 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:52.268733 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-248b6138-9946-4733-afa6-776319b6b6ee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:52.275481 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-248b6138-9946-4733-afa6-776319b6b6ee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:52.284346 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-248b6138-9946-4733-afa6-776319b6b6ee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:52.285196 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-248b6138-9946-4733-afa6-776319b6b6ee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:52.288383 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-248b6138-9946-4733-afa6-776319b6b6ee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:52.289395 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-248b6138-9946-4733-afa6-776319b6b6ee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:52.290091 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-248b6138-9946-4733-afa6-776319b6b6ee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:52.293384 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-248b6138-9946-4733-afa6-776319b6b6ee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:52.308351 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-429a360f-b771-4de8-ba8f-0db575fe4d3b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:52.319241 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-429a360f-b771-4de8-ba8f-0db575fe4d3b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 0.618329 Sep 19 12:26:52.324644 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 38/79] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:51 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:52.362401 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=4 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:52.491459 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-248b6138-9946-4733-afa6-776319b6b6ee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:52.494729 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-248b6138-9946-4733-afa6-776319b6b6ee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1321 microversion: 2.1 time: 0.236917 Sep 19 12:26:52.495314 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 42/80] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:52 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:52.505054 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-05ed64be-9f9d-4b0b-bdc7-20077142ec1c req-682bcd26-52e5-4ea0-ac50-9c986de4973d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3ee0aa-80a4-4587-a3dc-c9f654af3edc", "name": "network-vif-plugged", "status": "completed", "tag": "407a25f0-769d-4a17-9669-56cf43a8cdc3"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:26:52.533182 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-05ed64be-9f9d-4b0b-bdc7-20077142ec1c req-682bcd26-52e5-4ea0-ac50-9c986de4973d service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:52.534065 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-05ed64be-9f9d-4b0b-bdc7-20077142ec1c req-682bcd26-52e5-4ea0-ac50-9c986de4973d service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:52.534770 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-05ed64be-9f9d-4b0b-bdc7-20077142ec1c req-682bcd26-52e5-4ea0-ac50-9c986de4973d service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:52.559067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-05ed64be-9f9d-4b0b-bdc7-20077142ec1c req-682bcd26-52e5-4ea0-ac50-9c986de4973d service nova] Creating event network-vif-plugged:407a25f0-769d-4a17-9669-56cf43a8cdc3 for instance 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc on hv-cinder-85061 Sep 19 12:26:52.560885 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-05ed64be-9f9d-4b0b-bdc7-20077142ec1c req-682bcd26-52e5-4ea0-ac50-9c986de4973d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121429) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 12:26:52.561582 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-05ed64be-9f9d-4b0b-bdc7-20077142ec1c req-682bcd26-52e5-4ea0-ac50-9c986de4973d service nova] Acquired lock "compute-rpcapi-router" {{(pid=121429) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 12:26:52.562984 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-711d1a45-2110-4ff7-a41a-3b612a1b1ea7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:52.563835 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-711d1a45-2110-4ff7-a41a-3b612a1b1ea7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:52.564810 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-711d1a45-2110-4ff7-a41a-3b612a1b1ea7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:52.566064 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-711d1a45-2110-4ff7-a41a-3b612a1b1ea7 None None] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:52.566731 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-711d1a45-2110-4ff7-a41a-3b612a1b1ea7 None None] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:52.567372 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-711d1a45-2110-4ff7-a41a-3b612a1b1ea7 None None] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:52.578472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.compute.rpcapi [None req-711d1a45-2110-4ff7-a41a-3b612a1b1ea7 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 19 12:26:52.582815 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-711d1a45-2110-4ff7-a41a-3b612a1b1ea7 None None] Releasing lock "compute-rpcapi-router" {{(pid=121429) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 12:26:52.603809 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-711d1a45-2110-4ff7-a41a-3b612a1b1ea7 None None] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.282367 Sep 19 12:26:52.604699 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 39/81] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:26:52.722732 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-5b92ed48-a023-4bd2-a5b5-5d166cc05d45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:52.723343 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-5b92ed48-a023-4bd2-a5b5-5d166cc05d45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:52.729961 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5b92ed48-a023-4bd2-a5b5-5d166cc05d45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:52.730435 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5b92ed48-a023-4bd2-a5b5-5d166cc05d45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:52.730864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5b92ed48-a023-4bd2-a5b5-5d166cc05d45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:52.732090 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5b92ed48-a023-4bd2-a5b5-5d166cc05d45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:52.732548 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5b92ed48-a023-4bd2-a5b5-5d166cc05d45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:52.732999 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5b92ed48-a023-4bd2-a5b5-5d166cc05d45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:52.805545 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5b92ed48-a023-4bd2-a5b5-5d166cc05d45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:52.814669 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-5b92ed48-a023-4bd2-a5b5-5d166cc05d45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1301 microversion: 2.1 time: 0.095736 Sep 19 12:26:52.830604 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 43/82] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:52 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1301 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:53.283211 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-fcebedc8-49e9-44e1-8fef-28789a9e9a63 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:53.283920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-fcebedc8-49e9-44e1-8fef-28789a9e9a63 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:53.291107 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fcebedc8-49e9-44e1-8fef-28789a9e9a63 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:53.291355 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-928bf76f-88f6-4c45-9e77-f57f78c694bb req-601fa37e-84a3-4ad0-9ced-587d984cf6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded9ef48-10a2-4c68-bf0b-ad0e02e36308", "tag": "5e58fb6d-79ef-4674-8ba5-094c6cba4cd9"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:26:53.299194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fcebedc8-49e9-44e1-8fef-28789a9e9a63 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:53.299194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fcebedc8-49e9-44e1-8fef-28789a9e9a63 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:53.299194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fcebedc8-49e9-44e1-8fef-28789a9e9a63 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:53.299194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fcebedc8-49e9-44e1-8fef-28789a9e9a63 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:53.299613 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fcebedc8-49e9-44e1-8fef-28789a9e9a63 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:53.302279 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-928bf76f-88f6-4c45-9e77-f57f78c694bb req-601fa37e-84a3-4ad0-9ced-587d984cf6c4 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:53.303505 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-928bf76f-88f6-4c45-9e77-f57f78c694bb req-601fa37e-84a3-4ad0-9ced-587d984cf6c4 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:53.304258 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-928bf76f-88f6-4c45-9e77-f57f78c694bb req-601fa37e-84a3-4ad0-9ced-587d984cf6c4 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:53.316215 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-928bf76f-88f6-4c45-9e77-f57f78c694bb req-601fa37e-84a3-4ad0-9ced-587d984cf6c4 service nova] Creating event network-changed:5e58fb6d-79ef-4674-8ba5-094c6cba4cd9 for instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 on hv-cinder-85061 Sep 19 12:26:53.321743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-928bf76f-88f6-4c45-9e77-f57f78c694bb req-601fa37e-84a3-4ad0-9ced-587d984cf6c4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037724 Sep 19 12:26:53.322696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 44/83] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:26:53.350396 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-fb06a159-aa3c-4773-a1c8-0156fcb15b0a tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:53.351314 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-fb06a159-aa3c-4773-a1c8-0156fcb15b0a tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:53.358143 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fb06a159-aa3c-4773-a1c8-0156fcb15b0a tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:53.358618 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fb06a159-aa3c-4773-a1c8-0156fcb15b0a tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:53.362322 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fb06a159-aa3c-4773-a1c8-0156fcb15b0a tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:53.362322 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fb06a159-aa3c-4773-a1c8-0156fcb15b0a tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:53.362322 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fb06a159-aa3c-4773-a1c8-0156fcb15b0a tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:53.362322 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fb06a159-aa3c-4773-a1c8-0156fcb15b0a tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:53.514082 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-fcebedc8-49e9-44e1-8fef-28789a9e9a63 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:53.525299 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-fcebedc8-49e9-44e1-8fef-28789a9e9a63 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1362 microversion: 2.1 time: 0.246333 Sep 19 12:26:53.526628 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 40/84] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:53 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:53.546294 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-fb06a159-aa3c-4773-a1c8-0156fcb15b0a tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:53.546804 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-cbbe2409-f6a9-4137-9450-5507acca1df7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:53.547508 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-cbbe2409-f6a9-4137-9450-5507acca1df7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:53.558265 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cbbe2409-f6a9-4137-9450-5507acca1df7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:53.558956 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cbbe2409-f6a9-4137-9450-5507acca1df7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:53.560038 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cbbe2409-f6a9-4137-9450-5507acca1df7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:53.561040 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cbbe2409-f6a9-4137-9450-5507acca1df7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:53.565523 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cbbe2409-f6a9-4137-9450-5507acca1df7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:53.565523 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cbbe2409-f6a9-4137-9450-5507acca1df7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:53.568893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-fb06a159-aa3c-4773-a1c8-0156fcb15b0a tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 0.222799 Sep 19 12:26:53.577071 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 45/85] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:53 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:53.821049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-cbbe2409-f6a9-4137-9450-5507acca1df7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:53.829466 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-cbbe2409-f6a9-4137-9450-5507acca1df7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1321 microversion: 2.1 time: 0.301166 Sep 19 12:26:53.830059 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 41/86] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:53 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:53.838893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-6b00b4a9-60b5-4bbb-b645-8a970e09a5e7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:53.839518 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6b00b4a9-60b5-4bbb-b645-8a970e09a5e7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:53.846648 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6b00b4a9-60b5-4bbb-b645-8a970e09a5e7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:53.847136 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6b00b4a9-60b5-4bbb-b645-8a970e09a5e7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:53.847568 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6b00b4a9-60b5-4bbb-b645-8a970e09a5e7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:53.848466 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6b00b4a9-60b5-4bbb-b645-8a970e09a5e7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:53.849020 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6b00b4a9-60b5-4bbb-b645-8a970e09a5e7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:53.849515 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6b00b4a9-60b5-4bbb-b645-8a970e09a5e7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:53.915359 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-6b00b4a9-60b5-4bbb-b645-8a970e09a5e7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:53.923607 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-6b00b4a9-60b5-4bbb-b645-8a970e09a5e7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1301 microversion: 2.1 time: 0.088554 Sep 19 12:26:53.926986 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 46/87] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:53 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:54.550823 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-1c1c9ba0-4b91-46c0-9f5c-40d99180bc1c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:54.551453 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-1c1c9ba0-4b91-46c0-9f5c-40d99180bc1c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:54.558136 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c1c9ba0-4b91-46c0-9f5c-40d99180bc1c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:54.558629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c1c9ba0-4b91-46c0-9f5c-40d99180bc1c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:54.559067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c1c9ba0-4b91-46c0-9f5c-40d99180bc1c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:54.559767 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c1c9ba0-4b91-46c0-9f5c-40d99180bc1c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:54.560217 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c1c9ba0-4b91-46c0-9f5c-40d99180bc1c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:54.560772 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c1c9ba0-4b91-46c0-9f5c-40d99180bc1c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:54.597159 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-9887ee6e-69c6-4923-b470-3d0be85a67dc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:54.597768 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-9887ee6e-69c6-4923-b470-3d0be85a67dc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:54.610895 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9887ee6e-69c6-4923-b470-3d0be85a67dc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:54.611719 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9887ee6e-69c6-4923-b470-3d0be85a67dc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:54.612165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9887ee6e-69c6-4923-b470-3d0be85a67dc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:54.612929 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9887ee6e-69c6-4923-b470-3d0be85a67dc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:54.613465 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9887ee6e-69c6-4923-b470-3d0be85a67dc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:54.613902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9887ee6e-69c6-4923-b470-3d0be85a67dc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:54.765873 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=10 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:54.819168 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=10 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:54.892519 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-1c1c9ba0-4b91-46c0-9f5c-40d99180bc1c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:54.913412 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-1c1c9ba0-4b91-46c0-9f5c-40d99180bc1c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1362 microversion: 2.1 time: 0.359478 Sep 19 12:26:54.913412 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 42/88] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:54 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:54.916162 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-2e54d849-36e8-4e3c-9d1c-81e274b336f1 req-ada58739-b738-46f4-ba61-5343f7551b41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1", "name": "network-vif-plugged", "status": "completed", "tag": "c0f23c2d-a197-4591-96d2-604617c4253d"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:26:54.934724 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-2e54d849-36e8-4e3c-9d1c-81e274b336f1 req-ada58739-b738-46f4-ba61-5343f7551b41 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:54.935595 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-2e54d849-36e8-4e3c-9d1c-81e274b336f1 req-ada58739-b738-46f4-ba61-5343f7551b41 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:54.936642 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-2e54d849-36e8-4e3c-9d1c-81e274b336f1 req-ada58739-b738-46f4-ba61-5343f7551b41 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:54.959105 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-2e54d849-36e8-4e3c-9d1c-81e274b336f1 req-ada58739-b738-46f4-ba61-5343f7551b41 service nova] Creating event network-vif-plugged:c0f23c2d-a197-4591-96d2-604617c4253d for instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 on hv-cinder-85061 Sep 19 12:26:54.961929 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-9887ee6e-69c6-4923-b470-3d0be85a67dc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:54.969447 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-2e54d849-36e8-4e3c-9d1c-81e274b336f1 req-ada58739-b738-46f4-ba61-5343f7551b41 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058057 Sep 19 12:26:54.970558 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 43/89] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:26:54.973747 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-9887ee6e-69c6-4923-b470-3d0be85a67dc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 0.380445 Sep 19 12:26:54.978237 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 47/90] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:54 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:54.980398 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-8f761e3c-41c2-4de4-b728-f1d14c47f29f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:54.981777 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-8f761e3c-41c2-4de4-b728-f1d14c47f29f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:54.986493 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a9b07441-e9da-46bc-988b-d53d62a5b8bd tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:54.988568 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a9b07441-e9da-46bc-988b-d53d62a5b8bd tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:55.001466 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8f761e3c-41c2-4de4-b728-f1d14c47f29f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:55.002218 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8f761e3c-41c2-4de4-b728-f1d14c47f29f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:55.002847 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8f761e3c-41c2-4de4-b728-f1d14c47f29f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:55.003724 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8f761e3c-41c2-4de4-b728-f1d14c47f29f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:55.004341 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8f761e3c-41c2-4de4-b728-f1d14c47f29f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:55.005103 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8f761e3c-41c2-4de4-b728-f1d14c47f29f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:55.007975 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9b07441-e9da-46bc-988b-d53d62a5b8bd tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:55.008735 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9b07441-e9da-46bc-988b-d53d62a5b8bd tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:55.009249 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9b07441-e9da-46bc-988b-d53d62a5b8bd tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:55.011096 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9b07441-e9da-46bc-988b-d53d62a5b8bd tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:55.011730 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9b07441-e9da-46bc-988b-d53d62a5b8bd tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:55.012502 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9b07441-e9da-46bc-988b-d53d62a5b8bd tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:55.031031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=100 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:55.192542 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-a9b07441-e9da-46bc-988b-d53d62a5b8bd tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:55.223282 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a9b07441-e9da-46bc-988b-d53d62a5b8bd tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1311 microversion: 2.1 time: 0.229750 Sep 19 12:26:55.227120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 48/91] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:54 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1311 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:55.317915 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8f761e3c-41c2-4de4-b728-f1d14c47f29f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:55.328267 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-8f761e3c-41c2-4de4-b728-f1d14c47f29f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1321 microversion: 2.1 time: 0.355610 Sep 19 12:26:55.328267 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 44/92] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:54 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:55.933503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-9dc05999-9324-4d05-89a0-60fa30531f82 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:55.934093 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-9dc05999-9324-4d05-89a0-60fa30531f82 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:55.940114 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9dc05999-9324-4d05-89a0-60fa30531f82 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:55.940614 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9dc05999-9324-4d05-89a0-60fa30531f82 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:55.941048 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9dc05999-9324-4d05-89a0-60fa30531f82 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:55.941966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9dc05999-9324-4d05-89a0-60fa30531f82 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:55.942521 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9dc05999-9324-4d05-89a0-60fa30531f82 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:55.943029 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9dc05999-9324-4d05-89a0-60fa30531f82 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:56.003707 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3b5a1e55-c1cb-4794-86b5-78c9b263593f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:56.005115 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3b5a1e55-c1cb-4794-86b5-78c9b263593f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:56.012682 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b5a1e55-c1cb-4794-86b5-78c9b263593f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:56.013460 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b5a1e55-c1cb-4794-86b5-78c9b263593f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:56.014060 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b5a1e55-c1cb-4794-86b5-78c9b263593f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:56.016532 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b5a1e55-c1cb-4794-86b5-78c9b263593f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:56.016532 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b5a1e55-c1cb-4794-86b5-78c9b263593f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:56.016532 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b5a1e55-c1cb-4794-86b5-78c9b263593f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:56.202610 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-9dc05999-9324-4d05-89a0-60fa30531f82 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:56.211149 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-9dc05999-9324-4d05-89a0-60fa30531f82 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1362 microversion: 2.1 time: 0.281692 Sep 19 12:26:56.211741 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 49/93] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:55 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:56.246797 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3b5a1e55-c1cb-4794-86b5-78c9b263593f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:56.250925 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-bb0f9d25-65ae-49aa-a03e-c225c77d4a8e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:56.251467 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-bb0f9d25-65ae-49aa-a03e-c225c77d4a8e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:56.255790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3b5a1e55-c1cb-4794-86b5-78c9b263593f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 0.256050 Sep 19 12:26:56.256363 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 45/94] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:55 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:56.258059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bb0f9d25-65ae-49aa-a03e-c225c77d4a8e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:56.258769 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bb0f9d25-65ae-49aa-a03e-c225c77d4a8e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:56.259205 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bb0f9d25-65ae-49aa-a03e-c225c77d4a8e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:56.264774 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bb0f9d25-65ae-49aa-a03e-c225c77d4a8e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:56.264774 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bb0f9d25-65ae-49aa-a03e-c225c77d4a8e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:56.264774 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bb0f9d25-65ae-49aa-a03e-c225c77d4a8e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:56.343294 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-bb0f9d25-65ae-49aa-a03e-c225c77d4a8e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:56.351032 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-bb0f9d25-65ae-49aa-a03e-c225c77d4a8e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1299 microversion: 2.1 time: 0.104233 Sep 19 12:26:56.351455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9042930b-0336-4c7a-8cdd-c446c5c94053 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:56.352070 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9042930b-0336-4c7a-8cdd-c446c5c94053 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:56.352754 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 50/95] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:56 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:56.359204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9042930b-0336-4c7a-8cdd-c446c5c94053 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:56.359681 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9042930b-0336-4c7a-8cdd-c446c5c94053 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:56.360297 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9042930b-0336-4c7a-8cdd-c446c5c94053 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:56.361017 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9042930b-0336-4c7a-8cdd-c446c5c94053 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:56.361851 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9042930b-0336-4c7a-8cdd-c446c5c94053 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:56.362473 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9042930b-0336-4c7a-8cdd-c446c5c94053 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:56.499290 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9042930b-0336-4c7a-8cdd-c446c5c94053 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:56.506825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9042930b-0336-4c7a-8cdd-c446c5c94053 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1321 microversion: 2.1 time: 0.159695 Sep 19 12:26:56.507406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 46/96] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:56 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:56.984706 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-aa7923ce-2568-4560-96f3-3f70890282c7 req-3a67e329-0764-417c-9e6f-198ec3a64e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0ab2f3-883e-4b45-95d1-d0f8895fc401", "name": "network-vif-plugged", "status": "completed", "tag": "bfac18c5-608d-4385-8ac9-7abf25bb62fe"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:26:56.994949 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-aa7923ce-2568-4560-96f3-3f70890282c7 req-3a67e329-0764-417c-9e6f-198ec3a64e3f service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:56.995455 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-aa7923ce-2568-4560-96f3-3f70890282c7 req-3a67e329-0764-417c-9e6f-198ec3a64e3f service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:56.996111 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-aa7923ce-2568-4560-96f3-3f70890282c7 req-3a67e329-0764-417c-9e6f-198ec3a64e3f service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:57.008254 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-aa7923ce-2568-4560-96f3-3f70890282c7 req-3a67e329-0764-417c-9e6f-198ec3a64e3f service nova] Creating event network-vif-plugged:bfac18c5-608d-4385-8ac9-7abf25bb62fe for instance aa0ab2f3-883e-4b45-95d1-d0f8895fc401 on hv-cinder-85061 Sep 19 12:26:57.013323 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-aa7923ce-2568-4560-96f3-3f70890282c7 req-3a67e329-0764-417c-9e6f-198ec3a64e3f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032474 Sep 19 12:26:57.013919 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 51/97] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:26:57.236933 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-8bce16d8-8693-47e4-af9b-139de8414932 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:57.237782 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-8bce16d8-8693-47e4-af9b-139de8414932 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:57.245470 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8bce16d8-8693-47e4-af9b-139de8414932 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:57.245961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8bce16d8-8693-47e4-af9b-139de8414932 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:57.246391 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8bce16d8-8693-47e4-af9b-139de8414932 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:57.247135 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8bce16d8-8693-47e4-af9b-139de8414932 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:57.247575 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8bce16d8-8693-47e4-af9b-139de8414932 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:57.247998 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8bce16d8-8693-47e4-af9b-139de8414932 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:57.292417 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-87e10ef5-ca1a-4e55-9612-6d1aac626b5b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:57.293900 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-87e10ef5-ca1a-4e55-9612-6d1aac626b5b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:57.301556 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-87e10ef5-ca1a-4e55-9612-6d1aac626b5b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:57.302136 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-87e10ef5-ca1a-4e55-9612-6d1aac626b5b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:57.302699 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-87e10ef5-ca1a-4e55-9612-6d1aac626b5b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:57.303475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-87e10ef5-ca1a-4e55-9612-6d1aac626b5b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:57.304807 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-87e10ef5-ca1a-4e55-9612-6d1aac626b5b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:57.305475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-87e10ef5-ca1a-4e55-9612-6d1aac626b5b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:57.439702 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8bce16d8-8693-47e4-af9b-139de8414932 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:57.448024 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-8bce16d8-8693-47e4-af9b-139de8414932 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1362 microversion: 2.1 time: 0.215028 Sep 19 12:26:57.448619 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 47/98] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:57 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:57.453215 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-1514c764-415a-4abb-af18-f424bddd5daf tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:57.453823 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-1514c764-415a-4abb-af18-f424bddd5daf tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:57.461605 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1514c764-415a-4abb-af18-f424bddd5daf tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:57.462444 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1514c764-415a-4abb-af18-f424bddd5daf tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:57.463053 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1514c764-415a-4abb-af18-f424bddd5daf tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:57.464406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1514c764-415a-4abb-af18-f424bddd5daf tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:57.465673 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1514c764-415a-4abb-af18-f424bddd5daf tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:57.466252 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1514c764-415a-4abb-af18-f424bddd5daf tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:57.471100 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-87e10ef5-ca1a-4e55-9612-6d1aac626b5b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:57.482282 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-87e10ef5-ca1a-4e55-9612-6d1aac626b5b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 0.197022 Sep 19 12:26:57.482877 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 52/99] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:57 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:57.530547 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d3f40fe9-654e-4cf8-88b4-ef6419d07734 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:57.531546 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d3f40fe9-654e-4cf8-88b4-ef6419d07734 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:57.538227 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3f40fe9-654e-4cf8-88b4-ef6419d07734 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:57.538831 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3f40fe9-654e-4cf8-88b4-ef6419d07734 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:57.539518 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3f40fe9-654e-4cf8-88b4-ef6419d07734 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:57.540301 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3f40fe9-654e-4cf8-88b4-ef6419d07734 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:57.540863 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3f40fe9-654e-4cf8-88b4-ef6419d07734 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:57.541381 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3f40fe9-654e-4cf8-88b4-ef6419d07734 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:57.555444 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-1514c764-415a-4abb-af18-f424bddd5daf tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:57.576179 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-1514c764-415a-4abb-af18-f424bddd5daf tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1299 microversion: 2.1 time: 0.125029 Sep 19 12:26:57.584661 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 48/100] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:57 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1299 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:57.705342 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-d3f40fe9-654e-4cf8-88b4-ef6419d07734 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:57.713560 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d3f40fe9-654e-4cf8-88b4-ef6419d07734 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1321 microversion: 2.1 time: 0.187010 Sep 19 12:26:57.714240 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 53/101] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:57 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:26:58.471972 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-f7fb4754-51ef-434e-ae0b-9781bef0bf52 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:58.472662 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-f7fb4754-51ef-434e-ae0b-9781bef0bf52 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:58.483961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f7fb4754-51ef-434e-ae0b-9781bef0bf52 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:58.489949 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f7fb4754-51ef-434e-ae0b-9781bef0bf52 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:58.489949 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f7fb4754-51ef-434e-ae0b-9781bef0bf52 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:58.489949 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f7fb4754-51ef-434e-ae0b-9781bef0bf52 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:58.490493 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f7fb4754-51ef-434e-ae0b-9781bef0bf52 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:58.492542 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f7fb4754-51ef-434e-ae0b-9781bef0bf52 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:58.506762 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-dbcf3341-8cda-431f-92fa-01f53980d1bc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:58.508202 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-dbcf3341-8cda-431f-92fa-01f53980d1bc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:58.524990 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dbcf3341-8cda-431f-92fa-01f53980d1bc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:58.525498 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dbcf3341-8cda-431f-92fa-01f53980d1bc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:58.525944 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dbcf3341-8cda-431f-92fa-01f53980d1bc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:58.528052 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dbcf3341-8cda-431f-92fa-01f53980d1bc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:58.529364 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dbcf3341-8cda-431f-92fa-01f53980d1bc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:58.532281 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dbcf3341-8cda-431f-92fa-01f53980d1bc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:59.061102 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-f7fb4754-51ef-434e-ae0b-9781bef0bf52 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:59.069031 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-f7fb4754-51ef-434e-ae0b-9781bef0bf52 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1362 microversion: 2.1 time: 0.601507 Sep 19 12:26:59.070248 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 49/102] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:58 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1362 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:59.075176 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-8287c1a3-77df-4075-b674-3db4f466be84 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:59.075852 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-8287c1a3-77df-4075-b674-3db4f466be84 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:59.082396 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8287c1a3-77df-4075-b674-3db4f466be84 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:59.082893 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8287c1a3-77df-4075-b674-3db4f466be84 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:59.083332 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8287c1a3-77df-4075-b674-3db4f466be84 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:59.084036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8287c1a3-77df-4075-b674-3db4f466be84 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:59.084489 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8287c1a3-77df-4075-b674-3db4f466be84 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:59.085016 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8287c1a3-77df-4075-b674-3db4f466be84 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:59.107489 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-dbcf3341-8cda-431f-92fa-01f53980d1bc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:59.113329 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=100 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:59.118843 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-dbcf3341-8cda-431f-92fa-01f53980d1bc tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 0.617289 Sep 19 12:26:59.120204 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 54/103] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:58 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:59.125070 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-9cfe317f-e8ea-41bd-a576-571e10637874 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:59.125673 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-9cfe317f-e8ea-41bd-a576-571e10637874 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:59.134045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9cfe317f-e8ea-41bd-a576-571e10637874 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:59.134627 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9cfe317f-e8ea-41bd-a576-571e10637874 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:59.135128 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9cfe317f-e8ea-41bd-a576-571e10637874 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:59.135900 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9cfe317f-e8ea-41bd-a576-571e10637874 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:59.136425 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9cfe317f-e8ea-41bd-a576-571e10637874 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:59.136960 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9cfe317f-e8ea-41bd-a576-571e10637874 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:59.192646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8287c1a3-77df-4075-b674-3db4f466be84 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:59.200706 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-8287c1a3-77df-4075-b674-3db4f466be84 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1299 microversion: 2.1 time: 0.129349 Sep 19 12:26:59.201722 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 50/104] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:59 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1299 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:26:59.389151 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-9cfe317f-e8ea-41bd-a576-571e10637874 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:26:59.396906 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-9cfe317f-e8ea-41bd-a576-571e10637874 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1321 microversion: 2.1 time: 0.275527 Sep 19 12:26:59.397469 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 55/105] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:26:59 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:00.092891 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-815841c0-358d-4f5d-b473-a4b5c8c5e6f9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:00.093764 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-815841c0-358d-4f5d-b473-a4b5c8c5e6f9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:00.102083 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-815841c0-358d-4f5d-b473-a4b5c8c5e6f9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:00.102781 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-815841c0-358d-4f5d-b473-a4b5c8c5e6f9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:00.103434 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-815841c0-358d-4f5d-b473-a4b5c8c5e6f9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:00.105059 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-815841c0-358d-4f5d-b473-a4b5c8c5e6f9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:00.105821 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-815841c0-358d-4f5d-b473-a4b5c8c5e6f9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:00.106698 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-815841c0-358d-4f5d-b473-a4b5c8c5e6f9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:00.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-11dfe83c-eb2c-4593-aadc-8b70ea911b9f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:00.144539 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-11dfe83c-eb2c-4593-aadc-8b70ea911b9f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:00.151904 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-11dfe83c-eb2c-4593-aadc-8b70ea911b9f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:00.152397 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-11dfe83c-eb2c-4593-aadc-8b70ea911b9f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:00.152933 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-11dfe83c-eb2c-4593-aadc-8b70ea911b9f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:00.154010 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-11dfe83c-eb2c-4593-aadc-8b70ea911b9f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:00.154010 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-11dfe83c-eb2c-4593-aadc-8b70ea911b9f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:00.154441 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-11dfe83c-eb2c-4593-aadc-8b70ea911b9f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:00.308807 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-815841c0-358d-4f5d-b473-a4b5c8c5e6f9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:00.317504 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-815841c0-358d-4f5d-b473-a4b5c8c5e6f9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1362 microversion: 2.1 time: 0.228678 Sep 19 12:27:00.318932 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 51/106] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:00 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:00.335512 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-0900e1fa-5607-49de-ac6e-4e68c8be4f10 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:00.336354 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-0900e1fa-5607-49de-ac6e-4e68c8be4f10 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:00.345677 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-11dfe83c-eb2c-4593-aadc-8b70ea911b9f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:00.355164 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0900e1fa-5607-49de-ac6e-4e68c8be4f10 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:00.355662 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0900e1fa-5607-49de-ac6e-4e68c8be4f10 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:00.356147 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0900e1fa-5607-49de-ac6e-4e68c8be4f10 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:00.356770 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-11dfe83c-eb2c-4593-aadc-8b70ea911b9f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 0.215451 Sep 19 12:27:00.357607 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 56/107] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:00 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:27:00.358291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0900e1fa-5607-49de-ac6e-4e68c8be4f10 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:00.362061 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0900e1fa-5607-49de-ac6e-4e68c8be4f10 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:00.362061 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0900e1fa-5607-49de-ac6e-4e68c8be4f10 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:00.421317 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-20ae472b-afb8-455c-aac3-634fff9026c0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:00.422481 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-20ae472b-afb8-455c-aac3-634fff9026c0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:00.430001 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-20ae472b-afb8-455c-aac3-634fff9026c0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:00.430930 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-20ae472b-afb8-455c-aac3-634fff9026c0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:00.431920 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-20ae472b-afb8-455c-aac3-634fff9026c0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:00.432834 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-20ae472b-afb8-455c-aac3-634fff9026c0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:00.433437 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-20ae472b-afb8-455c-aac3-634fff9026c0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:00.436658 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-20ae472b-afb8-455c-aac3-634fff9026c0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:00.539868 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-0900e1fa-5607-49de-ac6e-4e68c8be4f10 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:00.552498 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-0900e1fa-5607-49de-ac6e-4e68c8be4f10 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.231431 Sep 19 12:27:00.553287 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 52/108] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:00 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:00.605025 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-20ae472b-afb8-455c-aac3-634fff9026c0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:00.613226 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-20ae472b-afb8-455c-aac3-634fff9026c0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1321 microversion: 2.1 time: 0.197535 Sep 19 12:27:00.613902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 57/109] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:00 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:27:01.368710 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2fd9dd84-8dd4-474d-8ee4-1f5f2a1a799d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:01.369904 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2fd9dd84-8dd4-474d-8ee4-1f5f2a1a799d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:01.376692 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2fd9dd84-8dd4-474d-8ee4-1f5f2a1a799d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:01.377367 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2fd9dd84-8dd4-474d-8ee4-1f5f2a1a799d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:01.377879 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2fd9dd84-8dd4-474d-8ee4-1f5f2a1a799d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:01.378691 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2fd9dd84-8dd4-474d-8ee4-1f5f2a1a799d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:01.379249 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2fd9dd84-8dd4-474d-8ee4-1f5f2a1a799d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:01.379681 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2fd9dd84-8dd4-474d-8ee4-1f5f2a1a799d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:01.434575 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-7091b9f5-8063-4e55-b780-be7780cfbf89 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:01.434575 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-7091b9f5-8063-4e55-b780-be7780cfbf89 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:01.434575 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7091b9f5-8063-4e55-b780-be7780cfbf89 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:01.434575 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7091b9f5-8063-4e55-b780-be7780cfbf89 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:01.435385 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7091b9f5-8063-4e55-b780-be7780cfbf89 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:01.435385 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7091b9f5-8063-4e55-b780-be7780cfbf89 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:01.435385 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7091b9f5-8063-4e55-b780-be7780cfbf89 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:01.435385 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7091b9f5-8063-4e55-b780-be7780cfbf89 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:01.671093 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2fd9dd84-8dd4-474d-8ee4-1f5f2a1a799d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:01.676856 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-7091b9f5-8063-4e55-b780-be7780cfbf89 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:01.682595 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2fd9dd84-8dd4-474d-8ee4-1f5f2a1a799d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1362 microversion: 2.1 time: 0.318923 Sep 19 12:27:01.686107 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-7091b9f5-8063-4e55-b780-be7780cfbf89 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1314 microversion: 2.1 time: 0.289207 Sep 19 12:27:01.686906 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 58/110] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:01 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:01.688239 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 53/111] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:01 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1362 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:01.694440 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c7c9b35f-620c-4925-96b8-b478b2ea7f0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:01.695087 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c7c9b35f-620c-4925-96b8-b478b2ea7f0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:01.701706 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c7c9b35f-620c-4925-96b8-b478b2ea7f0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:01.702206 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c7c9b35f-620c-4925-96b8-b478b2ea7f0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:01.702644 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c7c9b35f-620c-4925-96b8-b478b2ea7f0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:01.704739 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c7c9b35f-620c-4925-96b8-b478b2ea7f0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:01.704739 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c7c9b35f-620c-4925-96b8-b478b2ea7f0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:01.704930 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e26dd0b9-dbad-444a-9d2a-f6530fc4f34b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:01.705024 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c7c9b35f-620c-4925-96b8-b478b2ea7f0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:01.705135 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e26dd0b9-dbad-444a-9d2a-f6530fc4f34b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:01.713904 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e26dd0b9-dbad-444a-9d2a-f6530fc4f34b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:01.714743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e26dd0b9-dbad-444a-9d2a-f6530fc4f34b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:01.715382 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e26dd0b9-dbad-444a-9d2a-f6530fc4f34b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:01.716296 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e26dd0b9-dbad-444a-9d2a-f6530fc4f34b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:01.716985 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e26dd0b9-dbad-444a-9d2a-f6530fc4f34b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:01.717614 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e26dd0b9-dbad-444a-9d2a-f6530fc4f34b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:02.137247 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e26dd0b9-dbad-444a-9d2a-f6530fc4f34b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:02.162995 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e26dd0b9-dbad-444a-9d2a-f6530fc4f34b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.474750 Sep 19 12:27:02.163773 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 59/112] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:01 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:02.180334 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c7c9b35f-620c-4925-96b8-b478b2ea7f0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:02.193668 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c7c9b35f-620c-4925-96b8-b478b2ea7f0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1514 microversion: 2.1 time: 0.503890 Sep 19 12:27:02.195464 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 54/113] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:01 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1514 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:02.226564 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f4ad4a04-648f-4f26-a912-141a91bcbe26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:27:02.229220 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f4ad4a04-648f-4f26-a912-141a91bcbe26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:02.235506 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4ad4a04-648f-4f26-a912-141a91bcbe26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:02.236232 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4ad4a04-648f-4f26-a912-141a91bcbe26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:02.240162 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4ad4a04-648f-4f26-a912-141a91bcbe26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:02.240162 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4ad4a04-648f-4f26-a912-141a91bcbe26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:02.240162 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4ad4a04-648f-4f26-a912-141a91bcbe26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:02.240162 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4ad4a04-648f-4f26-a912-141a91bcbe26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:02.322691 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-f4ad4a04-648f-4f26-a912-141a91bcbe26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lazy-loading 'flavor' on Instance uuid 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:27:02.494367 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-be7b59a6-7d35-44f9-b5a4-f5bffeea7622 req-4646bb60-7796-4995-aabf-45acca1fadbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4930060-ddb1-4835-a231-ea79ffb14068", "tag": "c4e762c9-9e21-4d97-aae6-808ed7a47183"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:27:02.503857 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-be7b59a6-7d35-44f9-b5a4-f5bffeea7622 req-4646bb60-7796-4995-aabf-45acca1fadbc service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:02.504336 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-be7b59a6-7d35-44f9-b5a4-f5bffeea7622 req-4646bb60-7796-4995-aabf-45acca1fadbc service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:02.504884 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-be7b59a6-7d35-44f9-b5a4-f5bffeea7622 req-4646bb60-7796-4995-aabf-45acca1fadbc service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:02.517152 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-be7b59a6-7d35-44f9-b5a4-f5bffeea7622 req-4646bb60-7796-4995-aabf-45acca1fadbc service nova] Creating event network-changed:c4e762c9-9e21-4d97-aae6-808ed7a47183 for instance a4930060-ddb1-4835-a231-ea79ffb14068 on hv-cinder-85061 Sep 19 12:27:02.522596 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-be7b59a6-7d35-44f9-b5a4-f5bffeea7622 req-4646bb60-7796-4995-aabf-45acca1fadbc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032284 Sep 19 12:27:02.523545 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 55/114] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:27:02.702969 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=4 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:02.707009 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-dcb64b38-d231-45c2-b505-a3de99eca2a8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:02.707715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-dcb64b38-d231-45c2-b505-a3de99eca2a8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:02.714558 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dcb64b38-d231-45c2-b505-a3de99eca2a8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:02.715251 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dcb64b38-d231-45c2-b505-a3de99eca2a8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:02.715495 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dcb64b38-d231-45c2-b505-a3de99eca2a8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:02.716205 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dcb64b38-d231-45c2-b505-a3de99eca2a8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:02.716715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dcb64b38-d231-45c2-b505-a3de99eca2a8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:02.717325 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dcb64b38-d231-45c2-b505-a3de99eca2a8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:02.744020 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f4ad4a04-648f-4f26-a912-141a91bcbe26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "POST /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc/action" status: 200 len: 32 microversion: 2.1 time: 0.526987 Sep 19 12:27:02.747042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 60/115] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Sep 19 12:27:02 2022] POST /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc/action => generated 32 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 12:27:02.752698 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-6352e57d-a256-483d-8a2d-579f21e994c7 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:02.753413 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6352e57d-a256-483d-8a2d-579f21e994c7 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:02.760483 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6352e57d-a256-483d-8a2d-579f21e994c7 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:02.760999 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6352e57d-a256-483d-8a2d-579f21e994c7 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:02.761466 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6352e57d-a256-483d-8a2d-579f21e994c7 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:02.762166 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6352e57d-a256-483d-8a2d-579f21e994c7 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:02.762645 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6352e57d-a256-483d-8a2d-579f21e994c7 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:02.763092 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6352e57d-a256-483d-8a2d-579f21e994c7 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:02.937127 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-dcb64b38-d231-45c2-b505-a3de99eca2a8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:02.947832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-dcb64b38-d231-45c2-b505-a3de99eca2a8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1362 microversion: 2.1 time: 0.245999 Sep 19 12:27:02.949465 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 56/116] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:02 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:27:02.955876 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3fa7a3dc-e2b7-438a-bbaf-80ef943c5902 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:02.956798 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3fa7a3dc-e2b7-438a-bbaf-80ef943c5902 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:02.964930 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3fa7a3dc-e2b7-438a-bbaf-80ef943c5902 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:02.965569 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3fa7a3dc-e2b7-438a-bbaf-80ef943c5902 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:02.966142 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3fa7a3dc-e2b7-438a-bbaf-80ef943c5902 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:02.967002 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3fa7a3dc-e2b7-438a-bbaf-80ef943c5902 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:02.967684 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3fa7a3dc-e2b7-438a-bbaf-80ef943c5902 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:02.968281 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3fa7a3dc-e2b7-438a-bbaf-80ef943c5902 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:02.974115 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-6352e57d-a256-483d-8a2d-579f21e994c7 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:02.983398 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-6352e57d-a256-483d-8a2d-579f21e994c7 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1500 microversion: 2.1 time: 0.234946 Sep 19 12:27:02.986082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 61/117] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:02 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1500 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:03.154389 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3fa7a3dc-e2b7-438a-bbaf-80ef943c5902 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:03.162199 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3fa7a3dc-e2b7-438a-bbaf-80ef943c5902 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.211304 Sep 19 12:27:03.162763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 57/118] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:02 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:03.192834 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c3eda77b-fd78-481d-af24-7fb8c03a8dd4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:03.193875 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c3eda77b-fd78-481d-af24-7fb8c03a8dd4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:03.200440 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c3eda77b-fd78-481d-af24-7fb8c03a8dd4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:03.201287 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c3eda77b-fd78-481d-af24-7fb8c03a8dd4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:03.201721 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c3eda77b-fd78-481d-af24-7fb8c03a8dd4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:03.202404 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c3eda77b-fd78-481d-af24-7fb8c03a8dd4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:03.202988 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c3eda77b-fd78-481d-af24-7fb8c03a8dd4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:03.203536 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c3eda77b-fd78-481d-af24-7fb8c03a8dd4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:03.341400 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c3eda77b-fd78-481d-af24-7fb8c03a8dd4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:03.349410 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c3eda77b-fd78-481d-af24-7fb8c03a8dd4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.160701 Sep 19 12:27:03.350344 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 62/119] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:03 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:03.971379 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3b8ce405-0816-44f7-be94-7a61a21531c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:03.971985 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3b8ce405-0816-44f7-be94-7a61a21531c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:03.978523 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b8ce405-0816-44f7-be94-7a61a21531c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:03.978986 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b8ce405-0816-44f7-be94-7a61a21531c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:03.979413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b8ce405-0816-44f7-be94-7a61a21531c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:03.980104 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b8ce405-0816-44f7-be94-7a61a21531c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:03.980545 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b8ce405-0816-44f7-be94-7a61a21531c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:03.980996 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b8ce405-0816-44f7-be94-7a61a21531c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:04.109344 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3b8ce405-0816-44f7-be94-7a61a21531c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:04.117579 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3b8ce405-0816-44f7-be94-7a61a21531c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1362 microversion: 2.1 time: 0.150617 Sep 19 12:27:04.118148 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 58/120] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:03 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:04.187032 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-6d614619-fb9e-494b-9ad5-26376ce5372e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:04.187653 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6d614619-fb9e-494b-9ad5-26376ce5372e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:04.193658 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6d614619-fb9e-494b-9ad5-26376ce5372e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:04.194146 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6d614619-fb9e-494b-9ad5-26376ce5372e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:04.195510 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6d614619-fb9e-494b-9ad5-26376ce5372e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:04.196231 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6d614619-fb9e-494b-9ad5-26376ce5372e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:04.196742 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6d614619-fb9e-494b-9ad5-26376ce5372e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:04.199530 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6d614619-fb9e-494b-9ad5-26376ce5372e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:04.345198 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-6d614619-fb9e-494b-9ad5-26376ce5372e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:04.347543 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:04.354435 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-6d614619-fb9e-494b-9ad5-26376ce5372e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.171994 Sep 19 12:27:04.355023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 63/121] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:04 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:04.374307 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-888cfe65-894e-4828-b0e1-019806de50cc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:04.374914 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-888cfe65-894e-4828-b0e1-019806de50cc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:04.380984 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-888cfe65-894e-4828-b0e1-019806de50cc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:04.381471 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-888cfe65-894e-4828-b0e1-019806de50cc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:04.381901 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-888cfe65-894e-4828-b0e1-019806de50cc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:04.382771 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-888cfe65-894e-4828-b0e1-019806de50cc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:04.383097 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-888cfe65-894e-4828-b0e1-019806de50cc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:04.383522 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-888cfe65-894e-4828-b0e1-019806de50cc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:04.558020 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-888cfe65-894e-4828-b0e1-019806de50cc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:04.568115 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-888cfe65-894e-4828-b0e1-019806de50cc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.197571 Sep 19 12:27:04.569249 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 59/122] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:04 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:05.142888 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-07c42d3d-190c-4864-8088-9e9f6513764c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:05.143488 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-07c42d3d-190c-4864-8088-9e9f6513764c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:05.157366 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-07c42d3d-190c-4864-8088-9e9f6513764c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:05.157862 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-07c42d3d-190c-4864-8088-9e9f6513764c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:05.158325 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-07c42d3d-190c-4864-8088-9e9f6513764c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:05.159052 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-07c42d3d-190c-4864-8088-9e9f6513764c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:05.159500 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-07c42d3d-190c-4864-8088-9e9f6513764c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:05.159916 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-07c42d3d-190c-4864-8088-9e9f6513764c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:05.309223 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-07c42d3d-190c-4864-8088-9e9f6513764c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:05.318136 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-07c42d3d-190c-4864-8088-9e9f6513764c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1362 microversion: 2.1 time: 0.179322 Sep 19 12:27:05.318818 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 64/123] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:05 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:05.379276 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-27d7b19b-2390-4d4a-982c-c68234e170e9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:05.380538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-27d7b19b-2390-4d4a-982c-c68234e170e9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:05.387291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-27d7b19b-2390-4d4a-982c-c68234e170e9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:05.388012 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-27d7b19b-2390-4d4a-982c-c68234e170e9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:05.388665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-27d7b19b-2390-4d4a-982c-c68234e170e9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:05.389596 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-27d7b19b-2390-4d4a-982c-c68234e170e9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:05.392791 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-27d7b19b-2390-4d4a-982c-c68234e170e9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:05.392791 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-27d7b19b-2390-4d4a-982c-c68234e170e9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:05.521811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-d5f35f80-af25-4137-b497-44bf97bb6d33 req-2911c0f8-3f51-4bd8-ba83-153a0049ad9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded9ef48-10a2-4c68-bf0b-ad0e02e36308", "name": "network-vif-plugged", "status": "completed", "tag": "5e58fb6d-79ef-4674-8ba5-094c6cba4cd9"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:27:05.535088 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-d5f35f80-af25-4137-b497-44bf97bb6d33 req-2911c0f8-3f51-4bd8-ba83-153a0049ad9d service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:05.535863 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-d5f35f80-af25-4137-b497-44bf97bb6d33 req-2911c0f8-3f51-4bd8-ba83-153a0049ad9d service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:05.536333 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-d5f35f80-af25-4137-b497-44bf97bb6d33 req-2911c0f8-3f51-4bd8-ba83-153a0049ad9d service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:05.550483 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-27d7b19b-2390-4d4a-982c-c68234e170e9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:05.550670 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-d5f35f80-af25-4137-b497-44bf97bb6d33 req-2911c0f8-3f51-4bd8-ba83-153a0049ad9d service nova] Creating event network-vif-plugged:5e58fb6d-79ef-4674-8ba5-094c6cba4cd9 for instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 on hv-cinder-85061 Sep 19 12:27:05.553603 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-27d7b19b-2390-4d4a-982c-c68234e170e9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.178535 Sep 19 12:27:05.569724 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 60/124] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:05 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:05.570317 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-d5f35f80-af25-4137-b497-44bf97bb6d33 req-2911c0f8-3f51-4bd8-ba83-153a0049ad9d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040246 Sep 19 12:27:05.570317 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 65/125] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:27:05.592080 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b06cd781-5b0f-4cf9-ac89-b6310df4fc22 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:05.592731 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b06cd781-5b0f-4cf9-ac89-b6310df4fc22 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:05.594631 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:05.599582 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b06cd781-5b0f-4cf9-ac89-b6310df4fc22 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:05.600061 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b06cd781-5b0f-4cf9-ac89-b6310df4fc22 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:05.600555 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b06cd781-5b0f-4cf9-ac89-b6310df4fc22 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:05.602196 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b06cd781-5b0f-4cf9-ac89-b6310df4fc22 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:05.602308 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b06cd781-5b0f-4cf9-ac89-b6310df4fc22 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:05.602646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b06cd781-5b0f-4cf9-ac89-b6310df4fc22 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:05.745739 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-b06cd781-5b0f-4cf9-ac89-b6310df4fc22 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:05.756941 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-b06cd781-5b0f-4cf9-ac89-b6310df4fc22 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.168055 Sep 19 12:27:05.758127 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 61/126] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:05 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:06.010837 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e0cb4905-fd6e-42cf-9576-4ac9987df470 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "685d5ab1-d84c-489e-b08a-8c08f4e7adb0"}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:27:06.014040 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e0cb4905-fd6e-42cf-9576-4ac9987df470 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:06.022166 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e0cb4905-fd6e-42cf-9576-4ac9987df470 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:06.023527 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e0cb4905-fd6e-42cf-9576-4ac9987df470 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:06.024549 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e0cb4905-fd6e-42cf-9576-4ac9987df470 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:06.025780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e0cb4905-fd6e-42cf-9576-4ac9987df470 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:06.026468 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e0cb4905-fd6e-42cf-9576-4ac9987df470 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:06.027095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e0cb4905-fd6e-42cf-9576-4ac9987df470 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:06.342436 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-62a34ecf-904b-4152-89a0-9bd018604f2d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:06.343354 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-62a34ecf-904b-4152-89a0-9bd018604f2d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:06.351996 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-62a34ecf-904b-4152-89a0-9bd018604f2d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:06.354421 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-62a34ecf-904b-4152-89a0-9bd018604f2d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:06.355000 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-62a34ecf-904b-4152-89a0-9bd018604f2d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:06.357668 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-62a34ecf-904b-4152-89a0-9bd018604f2d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:06.360475 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-62a34ecf-904b-4152-89a0-9bd018604f2d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:06.361238 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-62a34ecf-904b-4152-89a0-9bd018604f2d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:07.021254 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-62a34ecf-904b-4152-89a0-9bd018604f2d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:07.034528 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-62a34ecf-904b-4152-89a0-9bd018604f2d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1362 microversion: 2.1 time: 0.696211 Sep 19 12:27:07.035735 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 62/127] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:06 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1362 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:27:07.045410 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-93f73ae1-f705-4c54-ad49-a900c81a8c5c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:07.047495 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-93f73ae1-f705-4c54-ad49-a900c81a8c5c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:07.065121 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-93f73ae1-f705-4c54-ad49-a900c81a8c5c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:07.067901 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-93f73ae1-f705-4c54-ad49-a900c81a8c5c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:07.067901 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-93f73ae1-f705-4c54-ad49-a900c81a8c5c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:07.067901 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-93f73ae1-f705-4c54-ad49-a900c81a8c5c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:07.067901 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-93f73ae1-f705-4c54-ad49-a900c81a8c5c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:07.075919 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-93f73ae1-f705-4c54-ad49-a900c81a8c5c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:07.400655 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e0cb4905-fd6e-42cf-9576-4ac9987df470 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "POST /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.395046 Sep 19 12:27:07.407327 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 66/128] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Sep 19 12:27:06 2022] POST /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1/os-volume_attachments => generated 194 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:27:07.418547 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a7587c1a-45b6-458b-87ac-6f4bbcef2817 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:07.421102 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a7587c1a-45b6-458b-87ac-6f4bbcef2817 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:07.429941 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a7587c1a-45b6-458b-87ac-6f4bbcef2817 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:07.431699 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a7587c1a-45b6-458b-87ac-6f4bbcef2817 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:07.431850 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-93f73ae1-f705-4c54-ad49-a900c81a8c5c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:07.432559 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a7587c1a-45b6-458b-87ac-6f4bbcef2817 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:07.433867 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a7587c1a-45b6-458b-87ac-6f4bbcef2817 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:07.434628 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a7587c1a-45b6-458b-87ac-6f4bbcef2817 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:07.435376 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a7587c1a-45b6-458b-87ac-6f4bbcef2817 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:07.441340 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-93f73ae1-f705-4c54-ad49-a900c81a8c5c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.404153 Sep 19 12:27:07.443335 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 63/129] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:07 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:07.604197 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-a7587c1a-45b6-458b-87ac-6f4bbcef2817 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:07.613824 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a7587c1a-45b6-458b-87ac-6f4bbcef2817 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.205620 Sep 19 12:27:07.614425 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 67/130] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:07 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:08.059263 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b0b2dfbe-a79c-4f13-a11b-a3e83c7ab46d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:08.059970 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b0b2dfbe-a79c-4f13-a11b-a3e83c7ab46d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:08.066065 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b0b2dfbe-a79c-4f13-a11b-a3e83c7ab46d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:08.066569 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b0b2dfbe-a79c-4f13-a11b-a3e83c7ab46d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:08.067003 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b0b2dfbe-a79c-4f13-a11b-a3e83c7ab46d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:08.067693 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b0b2dfbe-a79c-4f13-a11b-a3e83c7ab46d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:08.068141 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b0b2dfbe-a79c-4f13-a11b-a3e83c7ab46d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:08.068585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b0b2dfbe-a79c-4f13-a11b-a3e83c7ab46d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:08.299968 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-b0b2dfbe-a79c-4f13-a11b-a3e83c7ab46d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:08.310504 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-b0b2dfbe-a79c-4f13-a11b-a3e83c7ab46d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1362 microversion: 2.1 time: 0.255005 Sep 19 12:27:08.312080 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 64/131] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:08 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:08.473802 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-abc5a037-97d7-4ecd-8396-04d148a62c56 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:08.474418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-abc5a037-97d7-4ecd-8396-04d148a62c56 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:08.481899 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-abc5a037-97d7-4ecd-8396-04d148a62c56 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:08.482381 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-abc5a037-97d7-4ecd-8396-04d148a62c56 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:08.483074 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-abc5a037-97d7-4ecd-8396-04d148a62c56 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:08.483858 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-abc5a037-97d7-4ecd-8396-04d148a62c56 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:08.484436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-abc5a037-97d7-4ecd-8396-04d148a62c56 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:08.484911 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-abc5a037-97d7-4ecd-8396-04d148a62c56 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:08.625596 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-abc5a037-97d7-4ecd-8396-04d148a62c56 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:08.637524 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5c48a1cb-dfbe-4611-bad7-54d1bfa3bb43 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:08.639015 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-5c48a1cb-dfbe-4611-bad7-54d1bfa3bb43 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:08.644821 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-abc5a037-97d7-4ecd-8396-04d148a62c56 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.174861 Sep 19 12:27:08.649840 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 68/132] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:08 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:08.651132 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5c48a1cb-dfbe-4611-bad7-54d1bfa3bb43 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:08.651803 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5c48a1cb-dfbe-4611-bad7-54d1bfa3bb43 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:08.652383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5c48a1cb-dfbe-4611-bad7-54d1bfa3bb43 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:08.653369 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5c48a1cb-dfbe-4611-bad7-54d1bfa3bb43 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:08.653960 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5c48a1cb-dfbe-4611-bad7-54d1bfa3bb43 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:08.654529 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5c48a1cb-dfbe-4611-bad7-54d1bfa3bb43 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:08.795797 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-5c48a1cb-dfbe-4611-bad7-54d1bfa3bb43 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:08.803497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5c48a1cb-dfbe-4611-bad7-54d1bfa3bb43 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.169812 Sep 19 12:27:08.804123 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 65/133] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:08 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:27:09.335358 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-3690cdf8-7d6d-418a-b300-d5965cacc467 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:09.335998 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-3690cdf8-7d6d-418a-b300-d5965cacc467 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:09.342751 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3690cdf8-7d6d-418a-b300-d5965cacc467 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:09.343232 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3690cdf8-7d6d-418a-b300-d5965cacc467 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:09.343881 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3690cdf8-7d6d-418a-b300-d5965cacc467 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:09.344757 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3690cdf8-7d6d-418a-b300-d5965cacc467 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:09.345013 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3690cdf8-7d6d-418a-b300-d5965cacc467 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:09.345440 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3690cdf8-7d6d-418a-b300-d5965cacc467 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:09.482017 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-3690cdf8-7d6d-418a-b300-d5965cacc467 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:09.490608 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-3690cdf8-7d6d-418a-b300-d5965cacc467 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1362 microversion: 2.1 time: 0.158945 Sep 19 12:27:09.491714 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 69/134] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:09 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:09.674312 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9e4cf315-437d-475a-9306-f12625378fec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:09.674928 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9e4cf315-437d-475a-9306-f12625378fec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:09.681879 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9e4cf315-437d-475a-9306-f12625378fec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:09.682381 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9e4cf315-437d-475a-9306-f12625378fec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:09.682811 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9e4cf315-437d-475a-9306-f12625378fec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:09.683534 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9e4cf315-437d-475a-9306-f12625378fec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:09.683982 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9e4cf315-437d-475a-9306-f12625378fec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:09.684362 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9e4cf315-437d-475a-9306-f12625378fec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:09.822323 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9e4cf315-437d-475a-9306-f12625378fec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:09.826197 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-987e2b47-029e-4d9b-86b1-b7dd508e5a78 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:09.832140 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-987e2b47-029e-4d9b-86b1-b7dd508e5a78 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:09.832288 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9e4cf315-437d-475a-9306-f12625378fec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.159913 Sep 19 12:27:09.832288 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 66/135] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:09 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:09.833165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-987e2b47-029e-4d9b-86b1-b7dd508e5a78 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:09.833653 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-987e2b47-029e-4d9b-86b1-b7dd508e5a78 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:09.834094 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-987e2b47-029e-4d9b-86b1-b7dd508e5a78 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:09.834792 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-987e2b47-029e-4d9b-86b1-b7dd508e5a78 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:09.835248 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-987e2b47-029e-4d9b-86b1-b7dd508e5a78 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:09.835666 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-987e2b47-029e-4d9b-86b1-b7dd508e5a78 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:09.975918 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-987e2b47-029e-4d9b-86b1-b7dd508e5a78 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:09.983974 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-987e2b47-029e-4d9b-86b1-b7dd508e5a78 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.161683 Sep 19 12:27:09.984560 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 70/136] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:09 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:10.514493 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-62aaee8d-3125-4c81-be63-074f985f4e1e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:10.515091 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-62aaee8d-3125-4c81-be63-074f985f4e1e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:10.521469 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-62aaee8d-3125-4c81-be63-074f985f4e1e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:10.521941 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-62aaee8d-3125-4c81-be63-074f985f4e1e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:10.522370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-62aaee8d-3125-4c81-be63-074f985f4e1e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:10.523043 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-62aaee8d-3125-4c81-be63-074f985f4e1e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:10.523488 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-62aaee8d-3125-4c81-be63-074f985f4e1e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:10.523908 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-62aaee8d-3125-4c81-be63-074f985f4e1e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:10.658423 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-62aaee8d-3125-4c81-be63-074f985f4e1e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:10.661863 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=100 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:10.667307 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-62aaee8d-3125-4c81-be63-074f985f4e1e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1362 microversion: 2.1 time: 0.156617 Sep 19 12:27:10.667824 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 67/137] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:10 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:10.854816 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-56f54cb5-f862-4a00-92df-5acb48a8df39 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:10.855352 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-56f54cb5-f862-4a00-92df-5acb48a8df39 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:10.863072 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-56f54cb5-f862-4a00-92df-5acb48a8df39 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:10.863553 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-56f54cb5-f862-4a00-92df-5acb48a8df39 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:10.867492 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-56f54cb5-f862-4a00-92df-5acb48a8df39 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:10.867492 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-56f54cb5-f862-4a00-92df-5acb48a8df39 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:10.867492 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-56f54cb5-f862-4a00-92df-5acb48a8df39 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:10.867492 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-56f54cb5-f862-4a00-92df-5acb48a8df39 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:11.003813 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-56f54cb5-f862-4a00-92df-5acb48a8df39 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:11.007569 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ddcc6c6c-b083-4029-abc9-6f47f33dfa11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:11.008855 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ddcc6c6c-b083-4029-abc9-6f47f33dfa11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:11.012103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-56f54cb5-f862-4a00-92df-5acb48a8df39 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.161769 Sep 19 12:27:11.013287 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 71/138] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:10 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:11.017314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ddcc6c6c-b083-4029-abc9-6f47f33dfa11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:11.017998 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ddcc6c6c-b083-4029-abc9-6f47f33dfa11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:11.018508 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ddcc6c6c-b083-4029-abc9-6f47f33dfa11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:11.019358 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ddcc6c6c-b083-4029-abc9-6f47f33dfa11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:11.019847 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ddcc6c6c-b083-4029-abc9-6f47f33dfa11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:11.020412 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ddcc6c6c-b083-4029-abc9-6f47f33dfa11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:11.164015 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ddcc6c6c-b083-4029-abc9-6f47f33dfa11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:11.172431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ddcc6c6c-b083-4029-abc9-6f47f33dfa11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.169623 Sep 19 12:27:11.173126 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 68/139] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:11 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:27:11.691795 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-6d6a6c1f-ce8d-457c-8361-14faf3aefc04 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:11.692465 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6d6a6c1f-ce8d-457c-8361-14faf3aefc04 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:11.699394 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6d6a6c1f-ce8d-457c-8361-14faf3aefc04 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:11.699878 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6d6a6c1f-ce8d-457c-8361-14faf3aefc04 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:11.700311 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6d6a6c1f-ce8d-457c-8361-14faf3aefc04 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:11.701031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6d6a6c1f-ce8d-457c-8361-14faf3aefc04 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:11.701481 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6d6a6c1f-ce8d-457c-8361-14faf3aefc04 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:11.701902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6d6a6c1f-ce8d-457c-8361-14faf3aefc04 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:11.918770 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-6d6a6c1f-ce8d-457c-8361-14faf3aefc04 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:11.929923 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-6d6a6c1f-ce8d-457c-8361-14faf3aefc04 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1362 microversion: 2.1 time: 0.241904 Sep 19 12:27:11.930791 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 72/140] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:11 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:27:12.044158 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-6f253bfd-c9d1-4b18-bbd5-eded194741e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:12.044802 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-6f253bfd-c9d1-4b18-bbd5-eded194741e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:12.051326 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6f253bfd-c9d1-4b18-bbd5-eded194741e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:12.051804 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6f253bfd-c9d1-4b18-bbd5-eded194741e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:12.052234 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6f253bfd-c9d1-4b18-bbd5-eded194741e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:12.052980 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6f253bfd-c9d1-4b18-bbd5-eded194741e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:12.054065 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6f253bfd-c9d1-4b18-bbd5-eded194741e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:12.054466 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6f253bfd-c9d1-4b18-bbd5-eded194741e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:12.195783 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a3c6df91-0e64-4437-8bdf-0856af21d9f4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:12.196453 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a3c6df91-0e64-4437-8bdf-0856af21d9f4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:12.202641 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a3c6df91-0e64-4437-8bdf-0856af21d9f4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:12.203354 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a3c6df91-0e64-4437-8bdf-0856af21d9f4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:12.204174 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a3c6df91-0e64-4437-8bdf-0856af21d9f4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:12.204916 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a3c6df91-0e64-4437-8bdf-0856af21d9f4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:12.205519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a3c6df91-0e64-4437-8bdf-0856af21d9f4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:12.205946 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a3c6df91-0e64-4437-8bdf-0856af21d9f4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:12.206445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-6f253bfd-c9d1-4b18-bbd5-eded194741e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:12.215460 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-6f253bfd-c9d1-4b18-bbd5-eded194741e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.175238 Sep 19 12:27:12.216048 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 69/141] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:12 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:12.356705 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-a3c6df91-0e64-4437-8bdf-0856af21d9f4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:12.365218 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a3c6df91-0e64-4437-8bdf-0856af21d9f4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.173433 Sep 19 12:27:12.366470 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 73/142] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:12 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:12.956661 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-58453fc9-d1f3-4f70-af2d-f08145d0c315 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:12.957178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-58453fc9-d1f3-4f70-af2d-f08145d0c315 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:12.963918 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-58453fc9-d1f3-4f70-af2d-f08145d0c315 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:12.964401 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-58453fc9-d1f3-4f70-af2d-f08145d0c315 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:12.964862 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-58453fc9-d1f3-4f70-af2d-f08145d0c315 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:12.965635 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-58453fc9-d1f3-4f70-af2d-f08145d0c315 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:12.966091 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-58453fc9-d1f3-4f70-af2d-f08145d0c315 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:12.972314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-58453fc9-d1f3-4f70-af2d-f08145d0c315 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:13.132814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-58453fc9-d1f3-4f70-af2d-f08145d0c315 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:13.133996 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-58453fc9-d1f3-4f70-af2d-f08145d0c315 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1548 microversion: 2.1 time: 0.181341 Sep 19 12:27:13.134560 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 70/143] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:12 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1548 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:13.157169 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-3b9032b6-cbec-4309-a6bb-e0b9646ca2a9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:13.157655 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-3b9032b6-cbec-4309-a6bb-e0b9646ca2a9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:13.163955 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3b9032b6-cbec-4309-a6bb-e0b9646ca2a9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:13.164425 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3b9032b6-cbec-4309-a6bb-e0b9646ca2a9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:13.172847 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3b9032b6-cbec-4309-a6bb-e0b9646ca2a9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:13.172847 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3b9032b6-cbec-4309-a6bb-e0b9646ca2a9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:13.172847 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3b9032b6-cbec-4309-a6bb-e0b9646ca2a9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:13.172847 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3b9032b6-cbec-4309-a6bb-e0b9646ca2a9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:13.242902 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c1708607-7ee4-48bf-8b37-38de301ab785 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:13.244080 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c1708607-7ee4-48bf-8b37-38de301ab785 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:13.251074 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1708607-7ee4-48bf-8b37-38de301ab785 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:13.252116 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1708607-7ee4-48bf-8b37-38de301ab785 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:13.252941 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1708607-7ee4-48bf-8b37-38de301ab785 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:13.254234 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1708607-7ee4-48bf-8b37-38de301ab785 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:13.254843 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1708607-7ee4-48bf-8b37-38de301ab785 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:13.255638 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1708607-7ee4-48bf-8b37-38de301ab785 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:13.266026 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-3b9032b6-cbec-4309-a6bb-e0b9646ca2a9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112247 Sep 19 12:27:13.266735 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 74/144] 10.222.0.93 () {58 vars in 1275 bytes} [Mon Sep 19 12:27:13 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:27:13.396948 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a163993d-41cb-4a99-a8b3-3794d1dca78f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:13.402547 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a163993d-41cb-4a99-a8b3-3794d1dca78f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:13.416384 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a163993d-41cb-4a99-a8b3-3794d1dca78f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:13.425951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a163993d-41cb-4a99-a8b3-3794d1dca78f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:13.425951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a163993d-41cb-4a99-a8b3-3794d1dca78f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:13.430436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a163993d-41cb-4a99-a8b3-3794d1dca78f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:13.430436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a163993d-41cb-4a99-a8b3-3794d1dca78f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:13.430436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a163993d-41cb-4a99-a8b3-3794d1dca78f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:13.463222 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c1708607-7ee4-48bf-8b37-38de301ab785 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:13.477323 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c1708607-7ee4-48bf-8b37-38de301ab785 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.238931 Sep 19 12:27:13.488628 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 71/145] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:13 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:13.595971 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-a163993d-41cb-4a99-a8b3-3794d1dca78f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:13.618011 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a163993d-41cb-4a99-a8b3-3794d1dca78f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.233707 Sep 19 12:27:13.628959 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 75/146] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:13 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:27:14.503788 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-319498bf-0812-4df1-af8d-7df7a76a184b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:14.504533 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-319498bf-0812-4df1-af8d-7df7a76a184b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:14.511921 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-319498bf-0812-4df1-af8d-7df7a76a184b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:14.512939 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-319498bf-0812-4df1-af8d-7df7a76a184b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:14.513590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-319498bf-0812-4df1-af8d-7df7a76a184b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:14.514470 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-319498bf-0812-4df1-af8d-7df7a76a184b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:14.515133 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-319498bf-0812-4df1-af8d-7df7a76a184b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:14.516181 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-319498bf-0812-4df1-af8d-7df7a76a184b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:14.653443 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d91704bf-6d0c-4144-ad54-fc6f720f9853 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:14.654786 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d91704bf-6d0c-4144-ad54-fc6f720f9853 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:14.661819 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-319498bf-0812-4df1-af8d-7df7a76a184b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:14.665384 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d91704bf-6d0c-4144-ad54-fc6f720f9853 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:14.666132 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d91704bf-6d0c-4144-ad54-fc6f720f9853 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:14.666788 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d91704bf-6d0c-4144-ad54-fc6f720f9853 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:14.667496 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d91704bf-6d0c-4144-ad54-fc6f720f9853 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:14.668366 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d91704bf-6d0c-4144-ad54-fc6f720f9853 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:14.669013 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d91704bf-6d0c-4144-ad54-fc6f720f9853 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:14.671179 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-319498bf-0812-4df1-af8d-7df7a76a184b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.170991 Sep 19 12:27:14.672387 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 72/147] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:14 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:14.811785 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-d91704bf-6d0c-4144-ad54-fc6f720f9853 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:14.820889 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d91704bf-6d0c-4144-ad54-fc6f720f9853 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.172721 Sep 19 12:27:14.821472 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 76/148] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:14 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:14.842456 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-812d710b-05af-43f7-b133-c3e7d9256c63 req-1c02d22b-bcdd-4adb-8066-cbe6923ead16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded9ef48-10a2-4c68-bf0b-ad0e02e36308", "tag": "5e58fb6d-79ef-4674-8ba5-094c6cba4cd9"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:27:14.852099 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-812d710b-05af-43f7-b133-c3e7d9256c63 req-1c02d22b-bcdd-4adb-8066-cbe6923ead16 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:14.852690 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-812d710b-05af-43f7-b133-c3e7d9256c63 req-1c02d22b-bcdd-4adb-8066-cbe6923ead16 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:14.853177 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-812d710b-05af-43f7-b133-c3e7d9256c63 req-1c02d22b-bcdd-4adb-8066-cbe6923ead16 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:14.865291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-812d710b-05af-43f7-b133-c3e7d9256c63 req-1c02d22b-bcdd-4adb-8066-cbe6923ead16 service nova] Creating event network-changed:5e58fb6d-79ef-4674-8ba5-094c6cba4cd9 for instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 on hv-cinder-85061 Sep 19 12:27:14.871341 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-812d710b-05af-43f7-b133-c3e7d9256c63 req-1c02d22b-bcdd-4adb-8066-cbe6923ead16 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032602 Sep 19 12:27:14.872017 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 73/149] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:27:15.694644 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-6d60aa55-2cf2-46be-93e8-b088ff82733a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:15.695227 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6d60aa55-2cf2-46be-93e8-b088ff82733a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:15.701556 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6d60aa55-2cf2-46be-93e8-b088ff82733a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:15.705621 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6d60aa55-2cf2-46be-93e8-b088ff82733a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:15.705621 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6d60aa55-2cf2-46be-93e8-b088ff82733a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:15.705621 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6d60aa55-2cf2-46be-93e8-b088ff82733a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:15.705621 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6d60aa55-2cf2-46be-93e8-b088ff82733a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:15.705991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6d60aa55-2cf2-46be-93e8-b088ff82733a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:15.837110 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-6d60aa55-2cf2-46be-93e8-b088ff82733a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:15.845550 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-6d60aa55-2cf2-46be-93e8-b088ff82733a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.154726 Sep 19 12:27:15.845732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-d15cfbe7-2aa1-4068-a54d-ad2e0aeb827a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:15.846187 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 77/150] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:15 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:15.846299 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-d15cfbe7-2aa1-4068-a54d-ad2e0aeb827a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:15.853086 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d15cfbe7-2aa1-4068-a54d-ad2e0aeb827a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:15.853788 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d15cfbe7-2aa1-4068-a54d-ad2e0aeb827a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:15.854217 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d15cfbe7-2aa1-4068-a54d-ad2e0aeb827a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:15.854928 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d15cfbe7-2aa1-4068-a54d-ad2e0aeb827a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:15.855646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d15cfbe7-2aa1-4068-a54d-ad2e0aeb827a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:15.856073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d15cfbe7-2aa1-4068-a54d-ad2e0aeb827a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:15.989419 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-d15cfbe7-2aa1-4068-a54d-ad2e0aeb827a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:15.997058 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-d15cfbe7-2aa1-4068-a54d-ad2e0aeb827a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.156165 Sep 19 12:27:15.997625 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 74/151] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:15 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:16.882388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8400c37e-f0d8-4da8-b713-36f9eb6161c1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:16.882388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-8400c37e-f0d8-4da8-b713-36f9eb6161c1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:16.882388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8400c37e-f0d8-4da8-b713-36f9eb6161c1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:16.882388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8400c37e-f0d8-4da8-b713-36f9eb6161c1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:16.883774 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8400c37e-f0d8-4da8-b713-36f9eb6161c1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:16.883774 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8400c37e-f0d8-4da8-b713-36f9eb6161c1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:16.883774 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8400c37e-f0d8-4da8-b713-36f9eb6161c1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:16.883774 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8400c37e-f0d8-4da8-b713-36f9eb6161c1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:17.004920 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-8400c37e-f0d8-4da8-b713-36f9eb6161c1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:17.013277 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8400c37e-f0d8-4da8-b713-36f9eb6161c1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.147954 Sep 19 12:27:17.013854 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 78/152] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:16 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:17.019595 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3184fe1f-924b-48cf-bf12-0e0a652aab65 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:17.020207 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3184fe1f-924b-48cf-bf12-0e0a652aab65 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:17.026130 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3184fe1f-924b-48cf-bf12-0e0a652aab65 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:17.026604 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3184fe1f-924b-48cf-bf12-0e0a652aab65 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:17.027037 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3184fe1f-924b-48cf-bf12-0e0a652aab65 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:17.027719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3184fe1f-924b-48cf-bf12-0e0a652aab65 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:17.028166 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3184fe1f-924b-48cf-bf12-0e0a652aab65 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:17.028583 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3184fe1f-924b-48cf-bf12-0e0a652aab65 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:17.234461 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3184fe1f-924b-48cf-bf12-0e0a652aab65 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:17.242916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3184fe1f-924b-48cf-bf12-0e0a652aab65 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.227318 Sep 19 12:27:17.243669 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 75/153] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:17 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:18.037242 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e5815ec2-ef9a-40c7-a0b8-8747d29a4d13 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:18.038053 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e5815ec2-ef9a-40c7-a0b8-8747d29a4d13 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:18.046786 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e5815ec2-ef9a-40c7-a0b8-8747d29a4d13 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:18.047593 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e5815ec2-ef9a-40c7-a0b8-8747d29a4d13 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:18.048297 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e5815ec2-ef9a-40c7-a0b8-8747d29a4d13 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:18.049362 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e5815ec2-ef9a-40c7-a0b8-8747d29a4d13 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:18.049865 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e5815ec2-ef9a-40c7-a0b8-8747d29a4d13 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:18.050368 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e5815ec2-ef9a-40c7-a0b8-8747d29a4d13 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:18.181686 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e5815ec2-ef9a-40c7-a0b8-8747d29a4d13 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:18.189392 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e5815ec2-ef9a-40c7-a0b8-8747d29a4d13 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.157209 Sep 19 12:27:18.190955 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 79/154] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:18 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:18.267498 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-57d87ffd-8b65-4ba8-9c77-2f5bd2173dd7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:18.268129 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-57d87ffd-8b65-4ba8-9c77-2f5bd2173dd7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:18.274662 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-57d87ffd-8b65-4ba8-9c77-2f5bd2173dd7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:18.276748 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-57d87ffd-8b65-4ba8-9c77-2f5bd2173dd7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:18.276748 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-57d87ffd-8b65-4ba8-9c77-2f5bd2173dd7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:18.276748 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-57d87ffd-8b65-4ba8-9c77-2f5bd2173dd7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:18.276748 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-57d87ffd-8b65-4ba8-9c77-2f5bd2173dd7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:18.277209 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-57d87ffd-8b65-4ba8-9c77-2f5bd2173dd7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:18.411418 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-57d87ffd-8b65-4ba8-9c77-2f5bd2173dd7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:18.419716 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-57d87ffd-8b65-4ba8-9c77-2f5bd2173dd7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.156379 Sep 19 12:27:18.426002 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 76/155] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:18 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:19.214305 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-1ba8c8fd-73d4-4226-92cd-7bb51b3db5c9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:19.214918 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-1ba8c8fd-73d4-4226-92cd-7bb51b3db5c9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:19.221495 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1ba8c8fd-73d4-4226-92cd-7bb51b3db5c9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:19.221976 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1ba8c8fd-73d4-4226-92cd-7bb51b3db5c9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:19.222413 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1ba8c8fd-73d4-4226-92cd-7bb51b3db5c9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:19.223150 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1ba8c8fd-73d4-4226-92cd-7bb51b3db5c9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:19.223601 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1ba8c8fd-73d4-4226-92cd-7bb51b3db5c9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:19.224048 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1ba8c8fd-73d4-4226-92cd-7bb51b3db5c9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:19.226819 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:19.360653 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-1ba8c8fd-73d4-4226-92cd-7bb51b3db5c9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:19.369492 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-1ba8c8fd-73d4-4226-92cd-7bb51b3db5c9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.158703 Sep 19 12:27:19.372637 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 80/156] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:19 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:19.446421 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9a99fad2-9290-4831-9538-3deb2c8066d2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:19.447046 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9a99fad2-9290-4831-9538-3deb2c8066d2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:19.454876 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9a99fad2-9290-4831-9538-3deb2c8066d2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:19.455360 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9a99fad2-9290-4831-9538-3deb2c8066d2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:19.455789 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9a99fad2-9290-4831-9538-3deb2c8066d2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:19.456477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9a99fad2-9290-4831-9538-3deb2c8066d2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:19.456964 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9a99fad2-9290-4831-9538-3deb2c8066d2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:19.459688 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9a99fad2-9290-4831-9538-3deb2c8066d2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:19.584118 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9a99fad2-9290-4831-9538-3deb2c8066d2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:19.594520 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9a99fad2-9290-4831-9538-3deb2c8066d2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.151863 Sep 19 12:27:19.595088 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 77/157] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:19 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:20.391762 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ef1aef51-e098-4e76-a704-9a2293b3c003 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:20.396719 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-ef1aef51-e098-4e76-a704-9a2293b3c003 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:20.396719 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=100 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:20.401160 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ef1aef51-e098-4e76-a704-9a2293b3c003 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:20.401724 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ef1aef51-e098-4e76-a704-9a2293b3c003 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:20.402171 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ef1aef51-e098-4e76-a704-9a2293b3c003 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:20.402868 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ef1aef51-e098-4e76-a704-9a2293b3c003 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:20.403368 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ef1aef51-e098-4e76-a704-9a2293b3c003 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:20.403742 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ef1aef51-e098-4e76-a704-9a2293b3c003 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:20.535590 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-ef1aef51-e098-4e76-a704-9a2293b3c003 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:20.543286 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ef1aef51-e098-4e76-a704-9a2293b3c003 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.155865 Sep 19 12:27:20.543950 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 81/158] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:20 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:20.618042 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5e8b9f21-87a1-443a-9a23-9220c2f715e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:20.618651 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-5e8b9f21-87a1-443a-9a23-9220c2f715e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:20.624722 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5e8b9f21-87a1-443a-9a23-9220c2f715e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:20.625198 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5e8b9f21-87a1-443a-9a23-9220c2f715e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:20.625633 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5e8b9f21-87a1-443a-9a23-9220c2f715e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:20.626324 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5e8b9f21-87a1-443a-9a23-9220c2f715e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:20.626770 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5e8b9f21-87a1-443a-9a23-9220c2f715e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:20.627195 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5e8b9f21-87a1-443a-9a23-9220c2f715e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:20.755444 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-5e8b9f21-87a1-443a-9a23-9220c2f715e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:20.763581 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5e8b9f21-87a1-443a-9a23-9220c2f715e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.149876 Sep 19 12:27:20.764139 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 78/159] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:20 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:21.570514 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-1898bb63-ff6b-4f22-acd4-4a44c1e68c1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:21.570514 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-1898bb63-ff6b-4f22-acd4-4a44c1e68c1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:21.584448 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1898bb63-ff6b-4f22-acd4-4a44c1e68c1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:21.593181 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1898bb63-ff6b-4f22-acd4-4a44c1e68c1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:21.593858 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1898bb63-ff6b-4f22-acd4-4a44c1e68c1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:21.594775 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1898bb63-ff6b-4f22-acd4-4a44c1e68c1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:21.596101 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1898bb63-ff6b-4f22-acd4-4a44c1e68c1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:21.597012 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1898bb63-ff6b-4f22-acd4-4a44c1e68c1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:21.624920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-815b1648-3694-456e-8783-dcf91fa92698 req-595c187f-2a83-48ec-a2d8-55397a83f9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4930060-ddb1-4835-a231-ea79ffb14068", "name": "network-vif-plugged", "status": "completed", "tag": "c4e762c9-9e21-4d97-aae6-808ed7a47183"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:27:21.644371 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-815b1648-3694-456e-8783-dcf91fa92698 req-595c187f-2a83-48ec-a2d8-55397a83f9c3 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:21.644626 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-815b1648-3694-456e-8783-dcf91fa92698 req-595c187f-2a83-48ec-a2d8-55397a83f9c3 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:21.645004 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-815b1648-3694-456e-8783-dcf91fa92698 req-595c187f-2a83-48ec-a2d8-55397a83f9c3 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:21.659137 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-815b1648-3694-456e-8783-dcf91fa92698 req-595c187f-2a83-48ec-a2d8-55397a83f9c3 service nova] Creating event network-vif-plugged:c4e762c9-9e21-4d97-aae6-808ed7a47183 for instance a4930060-ddb1-4835-a231-ea79ffb14068 on hv-cinder-85061 Sep 19 12:27:21.668304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-815b1648-3694-456e-8783-dcf91fa92698 req-595c187f-2a83-48ec-a2d8-55397a83f9c3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047294 Sep 19 12:27:21.671823 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 79/160] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:27:21.770629 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-1898bb63-ff6b-4f22-acd4-4a44c1e68c1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:21.783333 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-1898bb63-ff6b-4f22-acd4-4a44c1e68c1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.219945 Sep 19 12:27:21.785329 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 82/161] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:21 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:27:21.786828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-724a5435-5b40-45f8-bcba-0577f115f767 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:21.787528 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-724a5435-5b40-45f8-bcba-0577f115f767 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:21.794259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-724a5435-5b40-45f8-bcba-0577f115f767 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:21.794744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-724a5435-5b40-45f8-bcba-0577f115f767 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:21.795177 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-724a5435-5b40-45f8-bcba-0577f115f767 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:21.795872 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-724a5435-5b40-45f8-bcba-0577f115f767 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:21.796432 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-724a5435-5b40-45f8-bcba-0577f115f767 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:21.796960 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-724a5435-5b40-45f8-bcba-0577f115f767 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:21.937477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-724a5435-5b40-45f8-bcba-0577f115f767 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:21.944280 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-724a5435-5b40-45f8-bcba-0577f115f767 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.161653 Sep 19 12:27:21.953771 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 80/162] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:21 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:22.806324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8e66c482-492e-41e1-91bd-5064bb89a992 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:22.806930 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-8e66c482-492e-41e1-91bd-5064bb89a992 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:22.813812 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8e66c482-492e-41e1-91bd-5064bb89a992 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:22.814502 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8e66c482-492e-41e1-91bd-5064bb89a992 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:22.815111 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8e66c482-492e-41e1-91bd-5064bb89a992 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:22.815793 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8e66c482-492e-41e1-91bd-5064bb89a992 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:22.816393 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8e66c482-492e-41e1-91bd-5064bb89a992 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:22.816834 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8e66c482-492e-41e1-91bd-5064bb89a992 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:22.973816 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-214ccfd4-b139-41a6-9523-8021aeabf4e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:22.974391 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-214ccfd4-b139-41a6-9523-8021aeabf4e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:22.981150 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-214ccfd4-b139-41a6-9523-8021aeabf4e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:22.982523 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-214ccfd4-b139-41a6-9523-8021aeabf4e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:22.983220 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-214ccfd4-b139-41a6-9523-8021aeabf4e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:22.984250 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-214ccfd4-b139-41a6-9523-8021aeabf4e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:22.984929 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-214ccfd4-b139-41a6-9523-8021aeabf4e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:22.985469 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-214ccfd4-b139-41a6-9523-8021aeabf4e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:23.105433 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-8e66c482-492e-41e1-91bd-5064bb89a992 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:23.116930 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8e66c482-492e-41e1-91bd-5064bb89a992 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.312044 Sep 19 12:27:23.118021 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 83/163] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:22 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:23.183361 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-214ccfd4-b139-41a6-9523-8021aeabf4e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:23.191418 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-214ccfd4-b139-41a6-9523-8021aeabf4e8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.227075 Sep 19 12:27:23.191618 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 81/164] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:22 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:27:24.140842 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-67f9beb7-543c-4232-a0f4-48601abad051 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:24.142276 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-67f9beb7-543c-4232-a0f4-48601abad051 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:24.153465 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-67f9beb7-543c-4232-a0f4-48601abad051 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:24.153956 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-67f9beb7-543c-4232-a0f4-48601abad051 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:24.154389 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-67f9beb7-543c-4232-a0f4-48601abad051 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:24.155076 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-67f9beb7-543c-4232-a0f4-48601abad051 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:24.155631 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-67f9beb7-543c-4232-a0f4-48601abad051 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:24.155926 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-67f9beb7-543c-4232-a0f4-48601abad051 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:24.214557 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c37e5623-d75a-47b4-8168-32eee0bf0eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:24.215279 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c37e5623-d75a-47b4-8168-32eee0bf0eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:24.221912 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c37e5623-d75a-47b4-8168-32eee0bf0eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:24.222398 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c37e5623-d75a-47b4-8168-32eee0bf0eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:24.222835 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c37e5623-d75a-47b4-8168-32eee0bf0eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:24.223624 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c37e5623-d75a-47b4-8168-32eee0bf0eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:24.224528 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c37e5623-d75a-47b4-8168-32eee0bf0eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:24.225014 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c37e5623-d75a-47b4-8168-32eee0bf0eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:24.367365 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-67f9beb7-543c-4232-a0f4-48601abad051 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:24.375267 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-67f9beb7-543c-4232-a0f4-48601abad051 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.238752 Sep 19 12:27:24.375941 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 84/165] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:24 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:24.393911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c37e5623-d75a-47b4-8168-32eee0bf0eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:24.401756 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c37e5623-d75a-47b4-8168-32eee0bf0eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.191217 Sep 19 12:27:24.402319 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 82/166] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:24 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:24.936033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-797255eb-7b0e-4533-8138-61dfb05e3454 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:24.936531 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-797255eb-7b0e-4533-8138-61dfb05e3454 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:24.942746 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-797255eb-7b0e-4533-8138-61dfb05e3454 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:24.943255 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-797255eb-7b0e-4533-8138-61dfb05e3454 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:24.943960 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-797255eb-7b0e-4533-8138-61dfb05e3454 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:24.944570 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-797255eb-7b0e-4533-8138-61dfb05e3454 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:24.945229 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-797255eb-7b0e-4533-8138-61dfb05e3454 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:24.945657 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-797255eb-7b0e-4533-8138-61dfb05e3454 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:24.971988 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-797255eb-7b0e-4533-8138-61dfb05e3454 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Going to try to terminate instance {{(pid=121428) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:27:25.346752 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-797255eb-7b0e-4533-8138-61dfb05e3454 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 204 len: 0 microversion: 2.1 time: 0.414256 Sep 19 12:27:25.355006 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 85/167] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:27:24 2022] DELETE /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:27:25.360181 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5f2da2a7-9a51-434d-a316-572dbde7ce7b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:25.360909 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-5f2da2a7-9a51-434d-a316-572dbde7ce7b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:25.368036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5f2da2a7-9a51-434d-a316-572dbde7ce7b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:25.368523 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5f2da2a7-9a51-434d-a316-572dbde7ce7b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:25.368989 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5f2da2a7-9a51-434d-a316-572dbde7ce7b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:25.369714 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5f2da2a7-9a51-434d-a316-572dbde7ce7b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:25.370168 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5f2da2a7-9a51-434d-a316-572dbde7ce7b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:25.370593 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5f2da2a7-9a51-434d-a316-572dbde7ce7b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:25.400714 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ce8e4614-5da1-4e62-a6cc-e5d23c965417 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:25.401403 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-ce8e4614-5da1-4e62-a6cc-e5d23c965417 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:25.407718 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ce8e4614-5da1-4e62-a6cc-e5d23c965417 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:25.408198 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ce8e4614-5da1-4e62-a6cc-e5d23c965417 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:25.408650 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ce8e4614-5da1-4e62-a6cc-e5d23c965417 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:25.409342 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ce8e4614-5da1-4e62-a6cc-e5d23c965417 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:25.409786 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ce8e4614-5da1-4e62-a6cc-e5d23c965417 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:25.410198 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ce8e4614-5da1-4e62-a6cc-e5d23c965417 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:25.579760 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-5f2da2a7-9a51-434d-a316-572dbde7ce7b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:25.591973 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-ce8e4614-5da1-4e62-a6cc-e5d23c965417 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:25.596095 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5f2da2a7-9a51-434d-a316-572dbde7ce7b tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1552 microversion: 2.1 time: 0.239325 Sep 19 12:27:25.597247 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 83/168] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:25 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1552 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:25.600433 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ce8e4614-5da1-4e62-a6cc-e5d23c965417 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.204564 Sep 19 12:27:25.603002 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9ac27bd0-80ad-47c1-b33e-39a0840b94db tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:25.603789 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9ac27bd0-80ad-47c1-b33e-39a0840b94db tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:25.610431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9ac27bd0-80ad-47c1-b33e-39a0840b94db tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:25.611526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9ac27bd0-80ad-47c1-b33e-39a0840b94db tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:25.612113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9ac27bd0-80ad-47c1-b33e-39a0840b94db tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:25.613178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9ac27bd0-80ad-47c1-b33e-39a0840b94db tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:25.613997 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 86/169] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:25 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:27:25.614699 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9ac27bd0-80ad-47c1-b33e-39a0840b94db tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:25.615416 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9ac27bd0-80ad-47c1-b33e-39a0840b94db tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:25.754040 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9ac27bd0-80ad-47c1-b33e-39a0840b94db tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:25.762363 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9ac27bd0-80ad-47c1-b33e-39a0840b94db tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.163613 Sep 19 12:27:25.762926 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 84/170] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:25 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:26.624300 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-cd1d914e-f00f-47bb-ba8e-1c77c0cf8a73 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:26.625226 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-cd1d914e-f00f-47bb-ba8e-1c77c0cf8a73 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:26.625483 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-8438eb99-d659-44be-b8fc-474e73fcf2e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:26.626093 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-8438eb99-d659-44be-b8fc-474e73fcf2e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:26.633052 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8438eb99-d659-44be-b8fc-474e73fcf2e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:26.633549 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8438eb99-d659-44be-b8fc-474e73fcf2e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:26.633986 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8438eb99-d659-44be-b8fc-474e73fcf2e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:26.634152 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cd1d914e-f00f-47bb-ba8e-1c77c0cf8a73 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:26.634682 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8438eb99-d659-44be-b8fc-474e73fcf2e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:26.634863 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cd1d914e-f00f-47bb-ba8e-1c77c0cf8a73 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:26.635119 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8438eb99-d659-44be-b8fc-474e73fcf2e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:26.635408 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cd1d914e-f00f-47bb-ba8e-1c77c0cf8a73 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:26.635725 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8438eb99-d659-44be-b8fc-474e73fcf2e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:26.636522 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cd1d914e-f00f-47bb-ba8e-1c77c0cf8a73 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:26.637165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cd1d914e-f00f-47bb-ba8e-1c77c0cf8a73 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:26.637831 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cd1d914e-f00f-47bb-ba8e-1c77c0cf8a73 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:26.862458 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-cd1d914e-f00f-47bb-ba8e-1c77c0cf8a73 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:26.870128 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-cd1d914e-f00f-47bb-ba8e-1c77c0cf8a73 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1552 microversion: 2.1 time: 0.252636 Sep 19 12:27:26.870362 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8438eb99-d659-44be-b8fc-474e73fcf2e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:26.871350 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 87/171] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:26 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1552 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:26.875098 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=100 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:26.885429 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e19fe9df-ef28-4bab-a069-5cc1ae6f4b62 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:26.886047 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e19fe9df-ef28-4bab-a069-5cc1ae6f4b62 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:26.886487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-8438eb99-d659-44be-b8fc-474e73fcf2e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.264832 Sep 19 12:27:26.887566 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 85/172] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:26 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:27:26.892558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e19fe9df-ef28-4bab-a069-5cc1ae6f4b62 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:26.895675 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e19fe9df-ef28-4bab-a069-5cc1ae6f4b62 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:26.895675 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e19fe9df-ef28-4bab-a069-5cc1ae6f4b62 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:26.895675 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e19fe9df-ef28-4bab-a069-5cc1ae6f4b62 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:26.895675 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e19fe9df-ef28-4bab-a069-5cc1ae6f4b62 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:26.895960 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e19fe9df-ef28-4bab-a069-5cc1ae6f4b62 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:27.035290 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e19fe9df-ef28-4bab-a069-5cc1ae6f4b62 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:27.042997 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e19fe9df-ef28-4bab-a069-5cc1ae6f4b62 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.162629 Sep 19 12:27:27.043566 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 88/173] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:26 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:27.895983 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2045cef5-f61a-41fe-8647-fc24193cd25e tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:27.896861 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2045cef5-f61a-41fe-8647-fc24193cd25e tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:27.903793 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2045cef5-f61a-41fe-8647-fc24193cd25e tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:27.904358 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2045cef5-f61a-41fe-8647-fc24193cd25e tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:27.904824 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2045cef5-f61a-41fe-8647-fc24193cd25e tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:27.905512 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2045cef5-f61a-41fe-8647-fc24193cd25e tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:27.905955 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2045cef5-f61a-41fe-8647-fc24193cd25e tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:27.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2045cef5-f61a-41fe-8647-fc24193cd25e tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:27.911017 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-fc670b1b-2163-40fa-9a16-faa44f29e0f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:27.911626 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-fc670b1b-2163-40fa-9a16-faa44f29e0f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:27.918689 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fc670b1b-2163-40fa-9a16-faa44f29e0f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:27.919166 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fc670b1b-2163-40fa-9a16-faa44f29e0f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:27.919599 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fc670b1b-2163-40fa-9a16-faa44f29e0f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:27.920288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fc670b1b-2163-40fa-9a16-faa44f29e0f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:27.920768 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fc670b1b-2163-40fa-9a16-faa44f29e0f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:27.921192 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fc670b1b-2163-40fa-9a16-faa44f29e0f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:28.108285 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2045cef5-f61a-41fe-8647-fc24193cd25e tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:28.115142 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-fc670b1b-2163-40fa-9a16-faa44f29e0f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:28.116882 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2045cef5-f61a-41fe-8647-fc24193cd25e tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1552 microversion: 2.1 time: 0.225398 Sep 19 12:27:28.117466 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 86/174] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:27 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1552 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:28.126836 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-1c03fe10-96d8-4a14-888b-2653ed520164 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:28.126836 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-1c03fe10-96d8-4a14-888b-2653ed520164 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:28.127080 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-fc670b1b-2163-40fa-9a16-faa44f29e0f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.215987 Sep 19 12:27:28.127080 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 89/175] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:27 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:28.128979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c03fe10-96d8-4a14-888b-2653ed520164 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:28.129455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c03fe10-96d8-4a14-888b-2653ed520164 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:28.130058 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c03fe10-96d8-4a14-888b-2653ed520164 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:28.130754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c03fe10-96d8-4a14-888b-2653ed520164 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:28.131205 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c03fe10-96d8-4a14-888b-2653ed520164 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:28.131626 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c03fe10-96d8-4a14-888b-2653ed520164 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:28.267338 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-1c03fe10-96d8-4a14-888b-2653ed520164 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:28.275572 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-1c03fe10-96d8-4a14-888b-2653ed520164 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.157154 Sep 19 12:27:28.276169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 87/176] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:28 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:29.141464 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-4f870f73-a978-41e7-b04c-e1596f344dd2 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:29.142179 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-4f870f73-a978-41e7-b04c-e1596f344dd2 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:29.150320 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c28fd6ed-e13c-4457-894d-818ec58ef3d7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:29.151140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c28fd6ed-e13c-4457-894d-818ec58ef3d7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:29.158815 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4f870f73-a978-41e7-b04c-e1596f344dd2 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:29.159478 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4f870f73-a978-41e7-b04c-e1596f344dd2 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:29.160713 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4f870f73-a978-41e7-b04c-e1596f344dd2 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:29.166315 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4f870f73-a978-41e7-b04c-e1596f344dd2 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:29.166315 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4f870f73-a978-41e7-b04c-e1596f344dd2 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:29.166315 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4f870f73-a978-41e7-b04c-e1596f344dd2 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:29.169746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c28fd6ed-e13c-4457-894d-818ec58ef3d7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:29.170633 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c28fd6ed-e13c-4457-894d-818ec58ef3d7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:29.171756 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c28fd6ed-e13c-4457-894d-818ec58ef3d7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:29.173889 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c28fd6ed-e13c-4457-894d-818ec58ef3d7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:29.175502 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c28fd6ed-e13c-4457-894d-818ec58ef3d7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:29.176519 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c28fd6ed-e13c-4457-894d-818ec58ef3d7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:29.370919 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-4f870f73-a978-41e7-b04c-e1596f344dd2 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:29.381461 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-4f870f73-a978-41e7-b04c-e1596f344dd2 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1552 microversion: 2.1 time: 0.245896 Sep 19 12:27:29.382606 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 90/177] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:29 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1552 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:29.387486 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e1fb50a1-e609-457c-acac-6f3b9ec9ed4e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:29.388168 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e1fb50a1-e609-457c-acac-6f3b9ec9ed4e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:29.395027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e1fb50a1-e609-457c-acac-6f3b9ec9ed4e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:29.395803 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e1fb50a1-e609-457c-acac-6f3b9ec9ed4e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:29.396429 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e1fb50a1-e609-457c-acac-6f3b9ec9ed4e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:29.397153 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e1fb50a1-e609-457c-acac-6f3b9ec9ed4e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:29.402165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e1fb50a1-e609-457c-acac-6f3b9ec9ed4e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:29.402165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e1fb50a1-e609-457c-acac-6f3b9ec9ed4e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:29.472926 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c28fd6ed-e13c-4457-894d-818ec58ef3d7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:29.498180 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c28fd6ed-e13c-4457-894d-818ec58ef3d7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.337591 Sep 19 12:27:29.498180 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 88/178] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:29 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:29.583016 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e1fb50a1-e609-457c-acac-6f3b9ec9ed4e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:29.591723 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e1fb50a1-e609-457c-acac-6f3b9ec9ed4e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1367 microversion: 2.1 time: 0.207810 Sep 19 12:27:29.592457 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 91/179] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:29 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:30.409002 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-1297e44b-6bfb-4f02-b08e-62e44530d93f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:30.409614 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-1297e44b-6bfb-4f02-b08e-62e44530d93f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:30.415509 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1297e44b-6bfb-4f02-b08e-62e44530d93f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:30.415985 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1297e44b-6bfb-4f02-b08e-62e44530d93f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:30.416517 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1297e44b-6bfb-4f02-b08e-62e44530d93f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:30.417215 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1297e44b-6bfb-4f02-b08e-62e44530d93f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:30.417664 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1297e44b-6bfb-4f02-b08e-62e44530d93f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:30.418082 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1297e44b-6bfb-4f02-b08e-62e44530d93f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:30.525844 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-377bc8b7-39f5-45bf-aa05-6d06ec2af58e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:30.526369 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-377bc8b7-39f5-45bf-aa05-6d06ec2af58e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:30.534524 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-377bc8b7-39f5-45bf-aa05-6d06ec2af58e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:30.535862 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-377bc8b7-39f5-45bf-aa05-6d06ec2af58e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:30.539114 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-377bc8b7-39f5-45bf-aa05-6d06ec2af58e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:30.542236 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-377bc8b7-39f5-45bf-aa05-6d06ec2af58e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:30.543993 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-377bc8b7-39f5-45bf-aa05-6d06ec2af58e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:30.544442 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-377bc8b7-39f5-45bf-aa05-6d06ec2af58e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:30.610741 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-1297e44b-6bfb-4f02-b08e-62e44530d93f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:30.623624 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-1297e44b-6bfb-4f02-b08e-62e44530d93f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1552 microversion: 2.1 time: 0.217883 Sep 19 12:27:30.624220 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 89/180] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:30 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1552 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:30.641853 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-33010c72-ba09-4599-92a4-a4f75b5844a7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:30.642470 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-33010c72-ba09-4599-92a4-a4f75b5844a7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:30.652439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33010c72-ba09-4599-92a4-a4f75b5844a7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:30.653198 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33010c72-ba09-4599-92a4-a4f75b5844a7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:30.653629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33010c72-ba09-4599-92a4-a4f75b5844a7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:30.654523 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33010c72-ba09-4599-92a4-a4f75b5844a7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:30.655017 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33010c72-ba09-4599-92a4-a4f75b5844a7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:30.655618 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33010c72-ba09-4599-92a4-a4f75b5844a7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:30.749494 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-377bc8b7-39f5-45bf-aa05-6d06ec2af58e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:30.760221 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-377bc8b7-39f5-45bf-aa05-6d06ec2af58e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.243248 Sep 19 12:27:30.760862 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 92/181] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:30 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:27:30.829532 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-33010c72-ba09-4599-92a4-a4f75b5844a7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:30.838280 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-33010c72-ba09-4599-92a4-a4f75b5844a7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1557 microversion: 2.1 time: 0.211631 Sep 19 12:27:30.838960 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 90/182] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:30 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1557 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:30.862816 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b1dcfcd1-cb5e-40bb-8f1a-cb4bbb7f77dc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:30.863455 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-b1dcfcd1-cb5e-40bb-8f1a-cb4bbb7f77dc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:30.870706 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b1dcfcd1-cb5e-40bb-8f1a-cb4bbb7f77dc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:30.871689 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b1dcfcd1-cb5e-40bb-8f1a-cb4bbb7f77dc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:30.872353 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b1dcfcd1-cb5e-40bb-8f1a-cb4bbb7f77dc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:30.873448 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b1dcfcd1-cb5e-40bb-8f1a-cb4bbb7f77dc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:30.874068 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b1dcfcd1-cb5e-40bb-8f1a-cb4bbb7f77dc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:30.874641 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b1dcfcd1-cb5e-40bb-8f1a-cb4bbb7f77dc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:30.962131 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-b1dcfcd1-cb5e-40bb-8f1a-cb4bbb7f77dc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103774 Sep 19 12:27:30.962942 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 93/183] 10.222.0.93 () {58 vars in 1275 bytes} [Mon Sep 19 12:27:30 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:27:31.647485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5932d8a2-ce84-4a7d-9c21-37ae05a5c8cd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:31.648834 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-5932d8a2-ce84-4a7d-9c21-37ae05a5c8cd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:31.655072 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5932d8a2-ce84-4a7d-9c21-37ae05a5c8cd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:31.655802 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5932d8a2-ce84-4a7d-9c21-37ae05a5c8cd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:31.656348 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5932d8a2-ce84-4a7d-9c21-37ae05a5c8cd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:31.657199 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5932d8a2-ce84-4a7d-9c21-37ae05a5c8cd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:31.657905 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5932d8a2-ce84-4a7d-9c21-37ae05a5c8cd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:31.658696 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5932d8a2-ce84-4a7d-9c21-37ae05a5c8cd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:31.787293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-0f7973f4-fe3f-4ea5-8a9b-35551201a63c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:31.787931 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-0f7973f4-fe3f-4ea5-8a9b-35551201a63c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:31.799678 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0f7973f4-fe3f-4ea5-8a9b-35551201a63c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:31.800185 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0f7973f4-fe3f-4ea5-8a9b-35551201a63c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:31.800728 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0f7973f4-fe3f-4ea5-8a9b-35551201a63c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:31.801541 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0f7973f4-fe3f-4ea5-8a9b-35551201a63c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:31.801991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0f7973f4-fe3f-4ea5-8a9b-35551201a63c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:31.806738 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0f7973f4-fe3f-4ea5-8a9b-35551201a63c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:31.930921 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-5932d8a2-ce84-4a7d-9c21-37ae05a5c8cd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:31.953090 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5932d8a2-ce84-4a7d-9c21-37ae05a5c8cd tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1552 microversion: 2.1 time: 0.308012 Sep 19 12:27:31.953090 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 91/184] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:31 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1552 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:27:32.101567 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-0f7973f4-fe3f-4ea5-8a9b-35551201a63c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:32.109301 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-0f7973f4-fe3f-4ea5-8a9b-35551201a63c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.325842 Sep 19 12:27:32.121109 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 94/185] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:31 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:27:32.398660 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-57a8eadf-b38a-4aa6-847c-365fb0ca735c req-457a215c-42f5-4323-a981-7788ae6c602a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4930060-ddb1-4835-a231-ea79ffb14068", "tag": "c4e762c9-9e21-4d97-aae6-808ed7a47183"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:27:32.413926 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-57a8eadf-b38a-4aa6-847c-365fb0ca735c req-457a215c-42f5-4323-a981-7788ae6c602a service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:32.414411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-57a8eadf-b38a-4aa6-847c-365fb0ca735c req-457a215c-42f5-4323-a981-7788ae6c602a service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:32.414841 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-57a8eadf-b38a-4aa6-847c-365fb0ca735c req-457a215c-42f5-4323-a981-7788ae6c602a service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:32.436295 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-57a8eadf-b38a-4aa6-847c-365fb0ca735c req-457a215c-42f5-4323-a981-7788ae6c602a service nova] Creating event network-changed:c4e762c9-9e21-4d97-aae6-808ed7a47183 for instance a4930060-ddb1-4835-a231-ea79ffb14068 on hv-cinder-85061 Sep 19 12:27:32.452623 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-57a8eadf-b38a-4aa6-847c-365fb0ca735c req-457a215c-42f5-4323-a981-7788ae6c602a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056521 Sep 19 12:27:32.455219 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 92/186] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:27:32.685040 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-e85cf14b-7d69-4d44-89f7-dafadafe7875 req-898f241d-bc83-41ae-bc50-8f068209f102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1", "name": "network-vif-deleted", "tag": "c0f23c2d-a197-4591-96d2-604617c4253d"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:27:32.698826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-e85cf14b-7d69-4d44-89f7-dafadafe7875 req-898f241d-bc83-41ae-bc50-8f068209f102 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:32.699863 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-e85cf14b-7d69-4d44-89f7-dafadafe7875 req-898f241d-bc83-41ae-bc50-8f068209f102 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:32.700908 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-e85cf14b-7d69-4d44-89f7-dafadafe7875 req-898f241d-bc83-41ae-bc50-8f068209f102 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:32.718730 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-e85cf14b-7d69-4d44-89f7-dafadafe7875 req-898f241d-bc83-41ae-bc50-8f068209f102 service nova] Creating event network-vif-deleted:c0f23c2d-a197-4591-96d2-604617c4253d for instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 on hv-cinder-85061 Sep 19 12:27:32.726665 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-e85cf14b-7d69-4d44-89f7-dafadafe7875 req-898f241d-bc83-41ae-bc50-8f068209f102 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049950 Sep 19 12:27:32.727341 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 95/187] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:27:32.977066 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-02d71555-b3dd-434a-a7f2-c980a9d37532 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:32.978393 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-02d71555-b3dd-434a-a7f2-c980a9d37532 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:32.986735 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-02d71555-b3dd-434a-a7f2-c980a9d37532 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:32.987384 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-02d71555-b3dd-434a-a7f2-c980a9d37532 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:32.987966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-02d71555-b3dd-434a-a7f2-c980a9d37532 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:32.988975 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-02d71555-b3dd-434a-a7f2-c980a9d37532 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:32.989569 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-02d71555-b3dd-434a-a7f2-c980a9d37532 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:32.990136 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-02d71555-b3dd-434a-a7f2-c980a9d37532 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:33.089084 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-02d71555-b3dd-434a-a7f2-c980a9d37532 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:33.097601 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-02d71555-b3dd-434a-a7f2-c980a9d37532 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1510 microversion: 2.1 time: 0.125888 Sep 19 12:27:33.099197 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 93/188] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:32 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1510 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:33.135933 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-86a7d4ae-595b-470a-9715-6296fbf5524b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:33.142022 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-86a7d4ae-595b-470a-9715-6296fbf5524b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:33.150621 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-86a7d4ae-595b-470a-9715-6296fbf5524b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:33.151110 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-86a7d4ae-595b-470a-9715-6296fbf5524b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:33.151542 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-86a7d4ae-595b-470a-9715-6296fbf5524b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:33.152277 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-86a7d4ae-595b-470a-9715-6296fbf5524b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:33.152697 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-86a7d4ae-595b-470a-9715-6296fbf5524b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:33.153965 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-86a7d4ae-595b-470a-9715-6296fbf5524b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:33.157113 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:33.350320 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-86a7d4ae-595b-470a-9715-6296fbf5524b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:33.363569 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-86a7d4ae-595b-470a-9715-6296fbf5524b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.233083 Sep 19 12:27:33.364176 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 96/189] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:33 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:34.121838 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5f0224c3-5a24-4829-aabc-ee9f8137b616 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:34.122634 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-5f0224c3-5a24-4829-aabc-ee9f8137b616 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:34.129072 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5f0224c3-5a24-4829-aabc-ee9f8137b616 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:34.129546 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5f0224c3-5a24-4829-aabc-ee9f8137b616 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:34.129972 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5f0224c3-5a24-4829-aabc-ee9f8137b616 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:34.130658 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5f0224c3-5a24-4829-aabc-ee9f8137b616 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:34.131096 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5f0224c3-5a24-4829-aabc-ee9f8137b616 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:34.131564 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5f0224c3-5a24-4829-aabc-ee9f8137b616 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:34.196474 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-5f0224c3-5a24-4829-aabc-ee9f8137b616 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:34.205163 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5f0224c3-5a24-4829-aabc-ee9f8137b616 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1510 microversion: 2.1 time: 0.087237 Sep 19 12:27:34.205740 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 94/190] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:34 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1510 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:34.389014 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-021bbff5-c5b9-4f96-92c4-2ffd6eba8ec3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:34.389574 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-021bbff5-c5b9-4f96-92c4-2ffd6eba8ec3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:34.398407 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-021bbff5-c5b9-4f96-92c4-2ffd6eba8ec3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:34.399238 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-021bbff5-c5b9-4f96-92c4-2ffd6eba8ec3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:34.399858 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-021bbff5-c5b9-4f96-92c4-2ffd6eba8ec3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:34.400578 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-021bbff5-c5b9-4f96-92c4-2ffd6eba8ec3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:34.401232 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-021bbff5-c5b9-4f96-92c4-2ffd6eba8ec3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:34.401665 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-021bbff5-c5b9-4f96-92c4-2ffd6eba8ec3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:34.544966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-021bbff5-c5b9-4f96-92c4-2ffd6eba8ec3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:34.557895 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-021bbff5-c5b9-4f96-92c4-2ffd6eba8ec3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.173329 Sep 19 12:27:34.558734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 97/191] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:34 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:35.230460 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c33ec58e-f60d-4bfe-a24d-23d58ce90e29 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:35.230460 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c33ec58e-f60d-4bfe-a24d-23d58ce90e29 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:35.240271 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c33ec58e-f60d-4bfe-a24d-23d58ce90e29 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:35.240789 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c33ec58e-f60d-4bfe-a24d-23d58ce90e29 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:35.241196 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c33ec58e-f60d-4bfe-a24d-23d58ce90e29 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:35.241899 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c33ec58e-f60d-4bfe-a24d-23d58ce90e29 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:35.242357 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c33ec58e-f60d-4bfe-a24d-23d58ce90e29 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:35.242895 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c33ec58e-f60d-4bfe-a24d-23d58ce90e29 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:35.338206 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c33ec58e-f60d-4bfe-a24d-23d58ce90e29 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:35.347770 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c33ec58e-f60d-4bfe-a24d-23d58ce90e29 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1345 microversion: 2.1 time: 0.123262 Sep 19 12:27:35.348338 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 95/192] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:35 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:35.583212 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-1cdc87d7-91d5-44c0-afa6-bcf056f97593 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:35.592218 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-1cdc87d7-91d5-44c0-afa6-bcf056f97593 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:35.592706 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1cdc87d7-91d5-44c0-afa6-bcf056f97593 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:35.593484 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1cdc87d7-91d5-44c0-afa6-bcf056f97593 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:35.594146 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1cdc87d7-91d5-44c0-afa6-bcf056f97593 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:35.595358 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1cdc87d7-91d5-44c0-afa6-bcf056f97593 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:35.596072 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1cdc87d7-91d5-44c0-afa6-bcf056f97593 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:35.596675 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1cdc87d7-91d5-44c0-afa6-bcf056f97593 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:35.814895 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-1cdc87d7-91d5-44c0-afa6-bcf056f97593 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:35.832788 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-1cdc87d7-91d5-44c0-afa6-bcf056f97593 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.244955 Sep 19 12:27:35.833702 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 98/193] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:35 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:36.371494 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-8195ca79-db99-46e2-9268-fa183c19f5ea tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:36.372103 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-8195ca79-db99-46e2-9268-fa183c19f5ea tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:36.378407 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8195ca79-db99-46e2-9268-fa183c19f5ea tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:36.379104 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8195ca79-db99-46e2-9268-fa183c19f5ea tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:36.379866 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8195ca79-db99-46e2-9268-fa183c19f5ea tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:36.385929 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8195ca79-db99-46e2-9268-fa183c19f5ea tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:36.385929 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8195ca79-db99-46e2-9268-fa183c19f5ea tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:36.385929 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8195ca79-db99-46e2-9268-fa183c19f5ea tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:36.415057 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8195ca79-db99-46e2-9268-fa183c19f5ea tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:36.415538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8195ca79-db99-46e2-9268-fa183c19f5ea tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:36.415967 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8195ca79-db99-46e2-9268-fa183c19f5ea tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:36.416502 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.objects.instance [None req-8195ca79-db99-46e2-9268-fa183c19f5ea tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lazy-loading 'fault' on Instance uuid e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 {{(pid=121429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:27:36.462045 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8195ca79-db99-46e2-9268-fa183c19f5ea tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825be558d6544a848293628e36b48c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70886a6d77434c90b59efd86c2395088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:36.470746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-8195ca79-db99-46e2-9268-fa183c19f5ea tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 200 len: 1350 microversion: 2.1 time: 0.103164 Sep 19 12:27:36.471781 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 96/194] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:36 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 1350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:36.858707 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-81f18ddd-c922-4cf4-a4fd-5e1fb2f596dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:36.858707 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-81f18ddd-c922-4cf4-a4fd-5e1fb2f596dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:36.865742 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81f18ddd-c922-4cf4-a4fd-5e1fb2f596dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:36.868135 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81f18ddd-c922-4cf4-a4fd-5e1fb2f596dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:36.868621 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81f18ddd-c922-4cf4-a4fd-5e1fb2f596dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:36.869354 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81f18ddd-c922-4cf4-a4fd-5e1fb2f596dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:36.869805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81f18ddd-c922-4cf4-a4fd-5e1fb2f596dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:36.870228 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81f18ddd-c922-4cf4-a4fd-5e1fb2f596dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:37.186698 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-81f18ddd-c922-4cf4-a4fd-5e1fb2f596dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:37.195668 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-81f18ddd-c922-4cf4-a4fd-5e1fb2f596dd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.341739 Sep 19 12:27:37.196255 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 99/195] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:36 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:37.495794 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b521ff40-4f52-4811-a0cf-f114d3771bb8 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:37.496418 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b521ff40-4f52-4811-a0cf-f114d3771bb8 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:37.504260 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b521ff40-4f52-4811-a0cf-f114d3771bb8 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:37.504772 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b521ff40-4f52-4811-a0cf-f114d3771bb8 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:37.505359 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b521ff40-4f52-4811-a0cf-f114d3771bb8 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:37.506207 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b521ff40-4f52-4811-a0cf-f114d3771bb8 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:37.507532 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b521ff40-4f52-4811-a0cf-f114d3771bb8 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:37.509010 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b521ff40-4f52-4811-a0cf-f114d3771bb8 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:37.529075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-b521ff40-4f52-4811-a0cf-f114d3771bb8 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] HTTP exception thrown: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b521ff40-4f52-4811-a0cf-f114d3771bb8 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Request method failure captured: Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 HTTP/1.1 Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKF_oVsbD6hyctLwrl5_aze_TVtyAX-Li53JAZ_fV58v3IJGofD_B0W-eaxgip0_eXM4ZUB7EA1w40svZzDbUw0YRYas9cgThZJ8UP5ImFBq0BAJ_q2tofxoFUYQ8Ps9_CHK_ylM8eRGkZ9WxEwIGv2vNRJ1sQWbbEiEQ9bq1fP2WflM Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 70886a6d77434c90b59efd86c2395088 Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-DeleteServersTestJSON-466998955 Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:27:37.534304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:27:37.536864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/70886a6d77434c90b59efd86c2395088"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_70886a6d77434c90b59efd86c2395088", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/70886a6d77434c90b59efd86c2395088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/70886a6d77434c90b59efd86c2395088"}]}] Sep 19 12:27:37.536864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-DeleteServersTestJSON-466998955 Sep 19 12:27:37.536864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 70886a6d77434c90b59efd86c2395088 Sep 19 12:27:37.536864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-DeleteServersTestJSON-466998955 Sep 19 12:27:37.536864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-DeleteServersTestJSON-466998955-project Sep 19 12:27:37.536864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:27:37.536864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:27:37.536864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 825be558d6544a848293628e36b48c06 Sep 19 12:27:37.536864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-DeleteServersTestJSON-466998955-project Sep 19 12:27:37.536864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:27:37.536864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:37.536864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': 'e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1'} Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:27:37.537646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:27:37.539124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:27:37.539124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:27:37.539124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:27:37.539124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:27:37.539124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:27:37.539124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:27:37.539124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:27:37.539124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:37.539124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:37.539124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:37.539124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:37.539124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:37.539124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:37.539124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:37.539124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:27:37.539124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:27:37.539124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:37.539124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:37.540262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b521ff40-4f52-4811-a0cf-f114d3771bb8 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Returning 404 to user: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:27:37.540262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-b521ff40-4f52-4811-a0cf-f114d3771bb8 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 404 len: 111 microversion: 2.1 time: 0.044692 Sep 19 12:27:37.540262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 97/196] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:37 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:27:37.669817 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-93785dcf-f6c4-4165-a421-1ed733ab3c0f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:37.671976 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-93785dcf-f6c4-4165-a421-1ed733ab3c0f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:37.677980 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-93785dcf-f6c4-4165-a421-1ed733ab3c0f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:37.678457 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-93785dcf-f6c4-4165-a421-1ed733ab3c0f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:37.679417 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-93785dcf-f6c4-4165-a421-1ed733ab3c0f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:37.680106 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-93785dcf-f6c4-4165-a421-1ed733ab3c0f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:37.680821 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-93785dcf-f6c4-4165-a421-1ed733ab3c0f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:37.681247 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-93785dcf-f6c4-4165-a421-1ed733ab3c0f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:37.694184 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-93785dcf-f6c4-4165-a421-1ed733ab3c0f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] HTTP exception thrown: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-93785dcf-f6c4-4165-a421-1ed733ab3c0f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Request method failure captured: Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1/os-volume_attachments HTTP/1.1 Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKF_oVsbD6hyctLwrl5_aze_TVtyAX-Li53JAZ_fV58v3IJGofD_B0W-eaxgip0_eXM4ZUB7EA1w40svZzDbUw0YRYas9cgThZJ8UP5ImFBq0BAJ_q2tofxoFUYQ8Ps9_CHK_ylM8eRGkZ9WxEwIGv2vNRJ1sQWbbEiEQ9bq1fP2WflM Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 70886a6d77434c90b59efd86c2395088 Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-DeleteServersTestJSON-466998955 Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:27:37.698871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:27:37.700191 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/70886a6d77434c90b59efd86c2395088"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_70886a6d77434c90b59efd86c2395088", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/70886a6d77434c90b59efd86c2395088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/70886a6d77434c90b59efd86c2395088"}]}] Sep 19 12:27:37.700191 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-DeleteServersTestJSON-466998955 Sep 19 12:27:37.700191 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 70886a6d77434c90b59efd86c2395088 Sep 19 12:27:37.700191 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-DeleteServersTestJSON-466998955 Sep 19 12:27:37.700191 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-DeleteServersTestJSON-466998955-project Sep 19 12:27:37.700191 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:27:37.700191 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:27:37.700191 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: 825be558d6544a848293628e36b48c06 Sep 19 12:27:37.700191 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-DeleteServersTestJSON-466998955-project Sep 19 12:27:37.700191 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:27:37.700191 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:37.700191 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'server_id': 'e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1'} Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:27:37.702351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:37.704028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:37.706021 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-93785dcf-f6c4-4165-a421-1ed733ab3c0f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Returning 404 to user: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:27:37.706021 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-93785dcf-f6c4-4165-a421-1ed733ab3c0f tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035350 Sep 19 12:27:37.706021 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 100/197] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Sep 19 12:27:37 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:27:38.219625 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-15afff56-a17d-4235-8767-8567d42ac1b7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:38.220232 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-15afff56-a17d-4235-8767-8567d42ac1b7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:38.226891 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-15afff56-a17d-4235-8767-8567d42ac1b7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:38.227361 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-15afff56-a17d-4235-8767-8567d42ac1b7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:38.227791 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-15afff56-a17d-4235-8767-8567d42ac1b7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:38.228462 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-15afff56-a17d-4235-8767-8567d42ac1b7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:38.228933 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-15afff56-a17d-4235-8767-8567d42ac1b7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:38.229349 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-15afff56-a17d-4235-8767-8567d42ac1b7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:38.368003 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-15afff56-a17d-4235-8767-8567d42ac1b7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:38.375937 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-15afff56-a17d-4235-8767-8567d42ac1b7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.160244 Sep 19 12:27:38.376453 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 98/198] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:38 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:39.399709 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-975fa56c-eb56-4e3c-990c-057ce08fd96a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:39.400926 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-975fa56c-eb56-4e3c-990c-057ce08fd96a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:39.407663 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-975fa56c-eb56-4e3c-990c-057ce08fd96a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:39.408149 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-975fa56c-eb56-4e3c-990c-057ce08fd96a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:39.408580 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-975fa56c-eb56-4e3c-990c-057ce08fd96a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:39.409297 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-975fa56c-eb56-4e3c-990c-057ce08fd96a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:39.409742 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-975fa56c-eb56-4e3c-990c-057ce08fd96a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:39.410163 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-975fa56c-eb56-4e3c-990c-057ce08fd96a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:39.545958 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-975fa56c-eb56-4e3c-990c-057ce08fd96a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:39.560337 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-975fa56c-eb56-4e3c-990c-057ce08fd96a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.164517 Sep 19 12:27:39.561792 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 101/199] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:39 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:39.698084 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4a67c447-55d8-44a5-94a1-474a44662449 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:39.698583 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4a67c447-55d8-44a5-94a1-474a44662449 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:39.700561 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=78 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:39.705471 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a67c447-55d8-44a5-94a1-474a44662449 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:39.705949 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a67c447-55d8-44a5-94a1-474a44662449 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:39.713719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a67c447-55d8-44a5-94a1-474a44662449 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:39.713719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a67c447-55d8-44a5-94a1-474a44662449 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:39.713719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a67c447-55d8-44a5-94a1-474a44662449 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:39.713719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a67c447-55d8-44a5-94a1-474a44662449 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:39.725214 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-4a67c447-55d8-44a5-94a1-474a44662449 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] HTTP exception thrown: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4a67c447-55d8-44a5-94a1-474a44662449 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Request method failure captured: Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: DELETE /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 HTTP/1.1 Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKF_oVsbD6hyctLwrl5_aze_TVtyAX-Li53JAZ_fV58v3IJGofD_B0W-eaxgip0_eXM4ZUB7EA1w40svZzDbUw0YRYas9cgThZJ8UP5ImFBq0BAJ_q2tofxoFUYQ8Ps9_CHK_ylM8eRGkZ9WxEwIGv2vNRJ1sQWbbEiEQ9bq1fP2WflM Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 70886a6d77434c90b59efd86c2395088 Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-DeleteServersTestJSON-466998955 Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:27:39.727154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:27:39.728431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/70886a6d77434c90b59efd86c2395088"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_70886a6d77434c90b59efd86c2395088", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/70886a6d77434c90b59efd86c2395088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/70886a6d77434c90b59efd86c2395088"}]}] Sep 19 12:27:39.728431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-DeleteServersTestJSON-466998955 Sep 19 12:27:39.728431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 70886a6d77434c90b59efd86c2395088 Sep 19 12:27:39.728431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-DeleteServersTestJSON-466998955 Sep 19 12:27:39.728431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-DeleteServersTestJSON-466998955-project Sep 19 12:27:39.728431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:27:39.728431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:27:39.728431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 825be558d6544a848293628e36b48c06 Sep 19 12:27:39.728431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-DeleteServersTestJSON-466998955-project Sep 19 12:27:39.728431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:27:39.728431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:39.728431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': 'e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1'} Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:27:39.729160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:39.730590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:39.732210 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4a67c447-55d8-44a5-94a1-474a44662449 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Returning 404 to user: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:27:39.732210 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4a67c447-55d8-44a5-94a1-474a44662449 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 404 len: 111 microversion: 2.1 time: 0.034509 Sep 19 12:27:39.732210 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 99/200] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:27:39 2022] DELETE /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:27:39.737193 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-3323e3d4-4bb5-49ab-8182-335b9be541e0 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:39.737796 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-3323e3d4-4bb5-49ab-8182-335b9be541e0 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] [instance: e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:39.744311 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3323e3d4-4bb5-49ab-8182-335b9be541e0 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:39.744833 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3323e3d4-4bb5-49ab-8182-335b9be541e0 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:39.745260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3323e3d4-4bb5-49ab-8182-335b9be541e0 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:39.745936 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3323e3d4-4bb5-49ab-8182-335b9be541e0 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:39.746380 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3323e3d4-4bb5-49ab-8182-335b9be541e0 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:39.747677 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3323e3d4-4bb5-49ab-8182-335b9be541e0 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:39.760989 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-3323e3d4-4bb5-49ab-8182-335b9be541e0 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] HTTP exception thrown: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-3323e3d4-4bb5-49ab-8182-335b9be541e0 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Request method failure captured: Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 HTTP/1.1 Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKF_oVsbD6hyctLwrl5_aze_TVtyAX-Li53JAZ_fV58v3IJGofD_B0W-eaxgip0_eXM4ZUB7EA1w40svZzDbUw0YRYas9cgThZJ8UP5ImFBq0BAJ_q2tofxoFUYQ8Ps9_CHK_ylM8eRGkZ9WxEwIGv2vNRJ1sQWbbEiEQ9bq1fP2WflM Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 70886a6d77434c90b59efd86c2395088 Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-DeleteServersTestJSON-466998955 Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:27:39.763165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:27:39.764452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/70886a6d77434c90b59efd86c2395088"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_70886a6d77434c90b59efd86c2395088", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/70886a6d77434c90b59efd86c2395088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/70886a6d77434c90b59efd86c2395088"}]}] Sep 19 12:27:39.764452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-DeleteServersTestJSON-466998955 Sep 19 12:27:39.764452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 70886a6d77434c90b59efd86c2395088 Sep 19 12:27:39.764452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-DeleteServersTestJSON-466998955 Sep 19 12:27:39.764452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-DeleteServersTestJSON-466998955-project Sep 19 12:27:39.764452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:27:39.764452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:27:39.764452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: 825be558d6544a848293628e36b48c06 Sep 19 12:27:39.764452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-DeleteServersTestJSON-466998955-project Sep 19 12:27:39.764452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:27:39.764452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:39.764452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': 'e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1'} Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:27:39.765399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:27:39.766864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:27:39.766864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:27:39.766864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:27:39.766864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:27:39.766864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:27:39.766864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:27:39.766864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:27:39.766864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:39.766864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:39.766864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:39.766864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:39.766864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:39.766864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:39.766864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:39.766864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:27:39.766864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:27:39.766864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. Sep 19 12:27:39.766864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:39.767801 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-3323e3d4-4bb5-49ab-8182-335b9be541e0 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] Returning 404 to user: Instance e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:27:39.767801 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-3323e3d4-4bb5-49ab-8182-335b9be541e0 tempest-DeleteServersTestJSON-466998955 tempest-DeleteServersTestJSON-466998955-project] 10.222.0.93 "GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1" status: 404 len: 111 microversion: 2.1 time: 0.031239 Sep 19 12:27:39.767801 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 102/201] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:39 2022] GET /compute/v2.1/servers/e1d37bd3-7efe-47eb-a3ac-08ec0eb131f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:27:40.587291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ae121190-dc9c-4a2d-ad7b-7eb99ab7b706 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:40.593218 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ae121190-dc9c-4a2d-ad7b-7eb99ab7b706 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:40.594491 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ae121190-dc9c-4a2d-ad7b-7eb99ab7b706 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:40.595047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ae121190-dc9c-4a2d-ad7b-7eb99ab7b706 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:40.595461 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ae121190-dc9c-4a2d-ad7b-7eb99ab7b706 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:40.596160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ae121190-dc9c-4a2d-ad7b-7eb99ab7b706 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:40.596622 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ae121190-dc9c-4a2d-ad7b-7eb99ab7b706 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:40.597178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ae121190-dc9c-4a2d-ad7b-7eb99ab7b706 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:40.834851 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ae121190-dc9c-4a2d-ad7b-7eb99ab7b706 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:40.842773 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ae121190-dc9c-4a2d-ad7b-7eb99ab7b706 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.260405 Sep 19 12:27:40.843359 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 100/202] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:40 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:41.870793 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b14aa374-0e03-475e-a710-3a2ad02e1900 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:41.871559 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-b14aa374-0e03-475e-a710-3a2ad02e1900 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:41.881369 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b14aa374-0e03-475e-a710-3a2ad02e1900 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:41.882209 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b14aa374-0e03-475e-a710-3a2ad02e1900 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:41.882858 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b14aa374-0e03-475e-a710-3a2ad02e1900 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:41.883913 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b14aa374-0e03-475e-a710-3a2ad02e1900 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:41.885137 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b14aa374-0e03-475e-a710-3a2ad02e1900 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:41.885639 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b14aa374-0e03-475e-a710-3a2ad02e1900 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:42.068140 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-b14aa374-0e03-475e-a710-3a2ad02e1900 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:42.076375 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-b14aa374-0e03-475e-a710-3a2ad02e1900 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.210626 Sep 19 12:27:42.077194 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 103/203] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:41 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:43.108240 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4a939fde-08bc-4964-8409-e4abb5ddd4c5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:43.111441 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4a939fde-08bc-4964-8409-e4abb5ddd4c5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:43.120460 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a939fde-08bc-4964-8409-e4abb5ddd4c5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:43.123103 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a939fde-08bc-4964-8409-e4abb5ddd4c5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:43.123739 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a939fde-08bc-4964-8409-e4abb5ddd4c5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:43.124995 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a939fde-08bc-4964-8409-e4abb5ddd4c5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:43.126056 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a939fde-08bc-4964-8409-e4abb5ddd4c5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:43.126704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a939fde-08bc-4964-8409-e4abb5ddd4c5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:43.688308 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-4a939fde-08bc-4964-8409-e4abb5ddd4c5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:43.699600 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4a939fde-08bc-4964-8409-e4abb5ddd4c5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.602290 Sep 19 12:27:43.700282 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 101/204] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:43 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:44.722848 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-1b9b180d-6017-4a08-931d-f6dfe727137c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:44.723476 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-1b9b180d-6017-4a08-931d-f6dfe727137c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:44.730832 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1b9b180d-6017-4a08-931d-f6dfe727137c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:44.731482 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1b9b180d-6017-4a08-931d-f6dfe727137c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:44.731905 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1b9b180d-6017-4a08-931d-f6dfe727137c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:44.738331 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1b9b180d-6017-4a08-931d-f6dfe727137c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:44.738331 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1b9b180d-6017-4a08-931d-f6dfe727137c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:44.738331 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1b9b180d-6017-4a08-931d-f6dfe727137c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:44.892577 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-1b9b180d-6017-4a08-931d-f6dfe727137c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:44.900416 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-1b9b180d-6017-4a08-931d-f6dfe727137c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.182282 Sep 19 12:27:44.901011 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 104/205] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:44 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:45.926444 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-8f8bc69b-ab17-4ea4-8a68-c19962e9f4e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:45.928658 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-8f8bc69b-ab17-4ea4-8a68-c19962e9f4e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:45.938007 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8f8bc69b-ab17-4ea4-8a68-c19962e9f4e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:45.938789 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8f8bc69b-ab17-4ea4-8a68-c19962e9f4e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:45.939522 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8f8bc69b-ab17-4ea4-8a68-c19962e9f4e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:45.940790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8f8bc69b-ab17-4ea4-8a68-c19962e9f4e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:45.941560 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8f8bc69b-ab17-4ea4-8a68-c19962e9f4e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:45.942132 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8f8bc69b-ab17-4ea4-8a68-c19962e9f4e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:46.105318 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8f8bc69b-ab17-4ea4-8a68-c19962e9f4e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:46.114235 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-8f8bc69b-ab17-4ea4-8a68-c19962e9f4e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.194044 Sep 19 12:27:46.130540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 102/206] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:45 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:47.137996 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e07192f9-dd98-43c1-9ec9-83b7568c23e6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:47.138527 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e07192f9-dd98-43c1-9ec9-83b7568c23e6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:47.145213 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e07192f9-dd98-43c1-9ec9-83b7568c23e6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:47.145700 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e07192f9-dd98-43c1-9ec9-83b7568c23e6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:47.146134 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e07192f9-dd98-43c1-9ec9-83b7568c23e6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:47.146873 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e07192f9-dd98-43c1-9ec9-83b7568c23e6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:47.147325 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e07192f9-dd98-43c1-9ec9-83b7568c23e6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:47.147744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e07192f9-dd98-43c1-9ec9-83b7568c23e6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:47.285413 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e07192f9-dd98-43c1-9ec9-83b7568c23e6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:47.295710 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e07192f9-dd98-43c1-9ec9-83b7568c23e6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.161222 Sep 19 12:27:47.296452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 105/207] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:47 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:47.982994 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5aca0669-68ec-462b-a71c-47ac0d9ecfaf tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Action: 'create', calling method: .version_select at 0x7f54b384a9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1774027382"}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:27:48.332728 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-de37b639-eab7-4e1f-ab4a-f2354df1590e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:48.333458 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-de37b639-eab7-4e1f-ab4a-f2354df1590e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:48.340687 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-de37b639-eab7-4e1f-ab4a-f2354df1590e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:48.341360 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-de37b639-eab7-4e1f-ab4a-f2354df1590e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:48.342190 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-de37b639-eab7-4e1f-ab4a-f2354df1590e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:48.343075 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-de37b639-eab7-4e1f-ab4a-f2354df1590e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:48.343716 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-de37b639-eab7-4e1f-ab4a-f2354df1590e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:48.344319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-de37b639-eab7-4e1f-ab4a-f2354df1590e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:48.514470 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-de37b639-eab7-4e1f-ab4a-f2354df1590e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:48.522824 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-de37b639-eab7-4e1f-ab4a-f2354df1590e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.193990 Sep 19 12:27:48.537063 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 106/208] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:48 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:48.784449 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5aca0669-68ec-462b-a71c-47ac0d9ecfaf tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.079843 Sep 19 12:27:48.789165 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 103/209] 10.222.0.93 () {60 vars in 1155 bytes} [Mon Sep 19 12:27:47 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1081 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 19 12:27:48.798989 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8f64f074-2c58-46ae-9010-e350ef4ba9cc tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Calling method '.version_select at 0x7f54b36c0280>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:48.875069 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8f64f074-2c58-46ae-9010-e350ef4ba9cc tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/1702b153-1778-4a9e-8c5d-9065e5706662" status: 200 len: 345 microversion: 2.1 time: 0.079566 Sep 19 12:27:48.876013 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 107/210] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Sep 19 12:27:48 2022] GET /compute/v2.1/os-volumes/1702b153-1778-4a9e-8c5d-9065e5706662 => generated 345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:27:49.547390 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-fccec9b7-7af8-412a-a29a-b0f564a0ac2e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:49.548117 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-fccec9b7-7af8-412a-a29a-b0f564a0ac2e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:49.557282 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fccec9b7-7af8-412a-a29a-b0f564a0ac2e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:49.558226 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fccec9b7-7af8-412a-a29a-b0f564a0ac2e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:49.558945 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fccec9b7-7af8-412a-a29a-b0f564a0ac2e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:49.560165 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fccec9b7-7af8-412a-a29a-b0f564a0ac2e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:49.560915 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fccec9b7-7af8-412a-a29a-b0f564a0ac2e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:49.561540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fccec9b7-7af8-412a-a29a-b0f564a0ac2e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:49.775491 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-fccec9b7-7af8-412a-a29a-b0f564a0ac2e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:49.783388 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-fccec9b7-7af8-412a-a29a-b0f564a0ac2e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.240438 Sep 19 12:27:49.783957 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 104/211] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:49 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:49.895533 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-92981327-4837-4f78-9fe9-2e7fb0dac4b6 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Calling method '.version_select at 0x7f54b37c0ee0>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:50.072628 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-92981327-4837-4f78-9fe9-2e7fb0dac4b6 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/1702b153-1778-4a9e-8c5d-9065e5706662" status: 200 len: 346 microversion: 2.1 time: 0.181625 Sep 19 12:27:50.073359 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 108/212] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Sep 19 12:27:49 2022] GET /compute/v2.1/os-volumes/1702b153-1778-4a9e-8c5d-9065e5706662 => generated 346 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:27:50.086738 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5d905378-7304-46bc-8b81-c01bc57089af tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Action: 'create', calling method: .version_select at 0x7f54b3a093a0>, body: {"snapshot": {"volume_id": "1702b153-1778-4a9e-8c5d-9065e5706662", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1867911601"}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:27:50.698620 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5d905378-7304-46bc-8b81-c01bc57089af tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.614729 Sep 19 12:27:50.698620 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 105/213] 10.222.0.93 () {60 vars in 1162 bytes} [Mon Sep 19 12:27:50 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:27:50.710038 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c0ed3bbf-3dfd-43d7-967a-772e8a2e5cd5 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Calling method '.version_select at 0x7f54b37b5c10>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:50.749136 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c0ed3bbf-3dfd-43d7-967a-772e8a2e5cd5 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f" status: 200 len: 287 microversion: 2.1 time: 0.043956 Sep 19 12:27:50.749754 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 109/214] 10.222.0.93 () {58 vars in 1251 bytes} [Mon Sep 19 12:27:50 2022] GET /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:27:50.761447 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-077fb275-d9c4-4ec5-b281-98094156c022 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Calling method '.version_select at 0x7f54b38d8940>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:50.795967 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-077fb275-d9c4-4ec5-b281-98094156c022 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.038451 Sep 19 12:27:50.797009 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 106/215] 10.222.0.93 () {58 vars in 1140 bytes} [Mon Sep 19 12:27:50 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:27:50.811881 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b57f80cd-cccc-4cae-a57d-63942b2865e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:50.812486 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b57f80cd-cccc-4cae-a57d-63942b2865e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:50.814410 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-0a3f783d-3bef-4f82-9c1e-efb5a1bd0e84 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Calling method '.version_select at 0x7f54b37c0e50>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:50.820373 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b57f80cd-cccc-4cae-a57d-63942b2865e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:50.821091 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b57f80cd-cccc-4cae-a57d-63942b2865e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:50.822264 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b57f80cd-cccc-4cae-a57d-63942b2865e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:50.823174 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b57f80cd-cccc-4cae-a57d-63942b2865e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:50.826981 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b57f80cd-cccc-4cae-a57d-63942b2865e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:50.827679 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b57f80cd-cccc-4cae-a57d-63942b2865e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:50.832506 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=100 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:50.856397 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-0a3f783d-3bef-4f82-9c1e-efb5a1bd0e84 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f" status: 200 len: 287 microversion: 2.1 time: 0.051732 Sep 19 12:27:50.856998 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 110/216] 10.222.0.93 () {58 vars in 1251 bytes} [Mon Sep 19 12:27:50 2022] GET /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:27:51.044562 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-b57f80cd-cccc-4cae-a57d-63942b2865e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:51.052275 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-b57f80cd-cccc-4cae-a57d-63942b2865e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.244071 Sep 19 12:27:51.053072 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 107/217] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:50 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:51.871798 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-99692187-97ae-4afc-9627-fd9fc048d5d8 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Calling method '.version_select at 0x7f54b399e1f0>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:51.903628 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-99692187-97ae-4afc-9627-fd9fc048d5d8 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f" status: 200 len: 287 microversion: 2.1 time: 0.036107 Sep 19 12:27:51.904194 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 111/218] 10.222.0.93 () {58 vars in 1251 bytes} [Mon Sep 19 12:27:51 2022] GET /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:27:52.077488 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-bc0a39c2-be23-4cf8-8d84-260dc01c2339 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:52.078506 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-bc0a39c2-be23-4cf8-8d84-260dc01c2339 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:52.087616 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bc0a39c2-be23-4cf8-8d84-260dc01c2339 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:52.088322 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bc0a39c2-be23-4cf8-8d84-260dc01c2339 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:52.088982 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bc0a39c2-be23-4cf8-8d84-260dc01c2339 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:52.090034 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bc0a39c2-be23-4cf8-8d84-260dc01c2339 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:52.090927 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bc0a39c2-be23-4cf8-8d84-260dc01c2339 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:52.091851 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bc0a39c2-be23-4cf8-8d84-260dc01c2339 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:52.336524 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-bc0a39c2-be23-4cf8-8d84-260dc01c2339 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:52.345751 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-bc0a39c2-be23-4cf8-8d84-260dc01c2339 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.273370 Sep 19 12:27:52.347135 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 108/219] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:52 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:52.917692 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b6d8ddf3-cec0-4de0-80f0-72bd69b6818e tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Calling method '.version_select at 0x7f54b3982670>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:52.951712 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-b6d8ddf3-cec0-4de0-80f0-72bd69b6818e tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f" status: 200 len: 287 microversion: 2.1 time: 0.038433 Sep 19 12:27:52.952286 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 112/220] 10.222.0.93 () {58 vars in 1251 bytes} [Mon Sep 19 12:27:52 2022] GET /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:27:53.371127 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-dc982108-abde-4dd2-a1b6-ad92a29038ce tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:53.371585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-dc982108-abde-4dd2-a1b6-ad92a29038ce tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:53.377936 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dc982108-abde-4dd2-a1b6-ad92a29038ce tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:53.378440 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dc982108-abde-4dd2-a1b6-ad92a29038ce tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:53.378966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dc982108-abde-4dd2-a1b6-ad92a29038ce tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:53.379652 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dc982108-abde-4dd2-a1b6-ad92a29038ce tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:53.380101 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dc982108-abde-4dd2-a1b6-ad92a29038ce tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:53.380514 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dc982108-abde-4dd2-a1b6-ad92a29038ce tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:53.515336 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-dc982108-abde-4dd2-a1b6-ad92a29038ce tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:53.523472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-dc982108-abde-4dd2-a1b6-ad92a29038ce tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.156357 Sep 19 12:27:53.524045 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 109/221] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:53 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:53.964955 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-572fe3bb-d0fc-440f-bac6-da6d6bc50165 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Calling method '.version_select at 0x7f54b36c0040>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:54.002758 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-572fe3bb-d0fc-440f-bac6-da6d6bc50165 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f" status: 200 len: 287 microversion: 2.1 time: 0.041698 Sep 19 12:27:54.003370 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 113/222] 10.222.0.93 () {58 vars in 1251 bytes} [Mon Sep 19 12:27:53 2022] GET /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:27:54.547322 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-7a7c3793-254c-4ce5-b14e-f828341f1924 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:54.548038 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-7a7c3793-254c-4ce5-b14e-f828341f1924 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:54.555160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7a7c3793-254c-4ce5-b14e-f828341f1924 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:54.555769 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7a7c3793-254c-4ce5-b14e-f828341f1924 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:54.556145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7a7c3793-254c-4ce5-b14e-f828341f1924 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:54.556831 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7a7c3793-254c-4ce5-b14e-f828341f1924 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:54.557585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7a7c3793-254c-4ce5-b14e-f828341f1924 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:54.557693 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7a7c3793-254c-4ce5-b14e-f828341f1924 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:54.694755 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-7a7c3793-254c-4ce5-b14e-f828341f1924 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:54.702527 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-7a7c3793-254c-4ce5-b14e-f828341f1924 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.159194 Sep 19 12:27:54.703094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 110/223] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:54 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:27:55.015827 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-1b655c26-1e3d-4639-8b2d-1d4848ff4335 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Calling method '.version_select at 0x7f54b383c820>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:55.067652 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-1b655c26-1e3d-4639-8b2d-1d4848ff4335 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f" status: 200 len: 287 microversion: 2.1 time: 0.047322 Sep 19 12:27:55.067652 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 114/224] 10.222.0.93 () {58 vars in 1251 bytes} [Mon Sep 19 12:27:55 2022] GET /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:27:55.728434 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-7bb485a7-5237-4d87-a463-64392f8a263a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:55.729271 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-7bb485a7-5237-4d87-a463-64392f8a263a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:55.735814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7bb485a7-5237-4d87-a463-64392f8a263a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:55.736300 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7bb485a7-5237-4d87-a463-64392f8a263a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:55.736773 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7bb485a7-5237-4d87-a463-64392f8a263a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:55.737857 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7bb485a7-5237-4d87-a463-64392f8a263a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:55.738241 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7bb485a7-5237-4d87-a463-64392f8a263a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:55.738653 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7bb485a7-5237-4d87-a463-64392f8a263a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:55.882293 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-7bb485a7-5237-4d87-a463-64392f8a263a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:55.890709 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-7bb485a7-5237-4d87-a463-64392f8a263a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1520 microversion: 2.1 time: 0.168909 Sep 19 12:27:55.891278 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 111/225] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:55 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:56.080371 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-0e9a30e8-afbb-4a6d-a45e-0455d1e4090c tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Calling method '.version_select at 0x7f54b37cf040>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:56.110837 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-0e9a30e8-afbb-4a6d-a45e-0455d1e4090c tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f" status: 200 len: 288 microversion: 2.1 time: 0.034951 Sep 19 12:27:56.111468 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 115/226] 10.222.0.93 () {58 vars in 1251 bytes} [Mon Sep 19 12:27:56 2022] GET /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:27:56.123434 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-52b27b9a-bd24-462b-b8a0-8713c44a4ab2 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Calling method '.version_select at 0x7f54b39413a0>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:56.249967 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-52b27b9a-bd24-462b-b8a0-8713c44a4ab2 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "DELETE /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f" status: 202 len: 0 microversion: 2.1 time: 0.130339 Sep 19 12:27:56.250528 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 112/227] 10.222.0.93 () {58 vars in 1254 bytes} [Mon Sep 19 12:27:56 2022] DELETE /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:27:56.260926 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e2d50ac2-969d-417b-9475-16ba50cb1007 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Calling method '.version_select at 0x7f54b37c0280>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:56.304445 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e2d50ac2-969d-417b-9475-16ba50cb1007 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f" status: 200 len: 287 microversion: 2.1 time: 0.046710 Sep 19 12:27:56.304941 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 116/228] 10.222.0.93 () {58 vars in 1251 bytes} [Mon Sep 19 12:27:56 2022] GET /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:27:56.914632 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-aa31731e-ce40-47f1-ae86-af8b89495a1a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:56.915185 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-aa31731e-ce40-47f1-ae86-af8b89495a1a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:56.921457 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aa31731e-ce40-47f1-ae86-af8b89495a1a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:56.921933 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aa31731e-ce40-47f1-ae86-af8b89495a1a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:56.922364 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aa31731e-ce40-47f1-ae86-af8b89495a1a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:56.923111 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aa31731e-ce40-47f1-ae86-af8b89495a1a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:56.923557 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aa31731e-ce40-47f1-ae86-af8b89495a1a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:56.923973 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aa31731e-ce40-47f1-ae86-af8b89495a1a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:57.066917 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-aa31731e-ce40-47f1-ae86-af8b89495a1a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:57.076343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-aa31731e-ce40-47f1-ae86-af8b89495a1a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1500 microversion: 2.1 time: 0.165481 Sep 19 12:27:57.076437 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 113/229] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:56 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1500 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:27:57.100165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-025113c4-55cd-4839-969e-3ea435bc0cea tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:57.106891 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-025113c4-55cd-4839-969e-3ea435bc0cea tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:57.106891 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:57.107564 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-025113c4-55cd-4839-969e-3ea435bc0cea tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:57.108050 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-025113c4-55cd-4839-969e-3ea435bc0cea tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:57.108633 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-025113c4-55cd-4839-969e-3ea435bc0cea tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:57.109284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-025113c4-55cd-4839-969e-3ea435bc0cea tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:57.109735 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-025113c4-55cd-4839-969e-3ea435bc0cea tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:57.110345 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-025113c4-55cd-4839-969e-3ea435bc0cea tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:57.261307 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-025113c4-55cd-4839-969e-3ea435bc0cea tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:57.263861 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-025113c4-55cd-4839-969e-3ea435bc0cea tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1514 microversion: 2.1 time: 0.168815 Sep 19 12:27:57.264440 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 117/230] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:57 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:57.316941 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-891b8769-675a-480b-9b42-ddb91e2a63d7 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Calling method '.version_select at 0x7f54b3822c10>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-891b8769-675a-480b-9b42-ddb91e2a63d7 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] HTTP exception thrown: Snapshot 3034278b-0850-45b3-8332-5ad88291042f could not be found. Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-891b8769-675a-480b-9b42-ddb91e2a63d7 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Request method failure captured: Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: GET /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f HTTP/1.1 Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKGBDjYPcCdNA-Tr8dI2uN_ZyriNN6UwbM54Bn1TsjFlqhB_PLPUkRZKmJcx0LK30h7GST2992GbMC1KlY3YfDHdaugCfkSTxVNYD7zacX5u8JmFDxNPKlgGQqxLdhuuBkvsGNFGnnb4jbwchd-_ojsPQgWuK_rwsYFt4Q7kz0N2uAf8 Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 8e41380c40e543fdb3c280c9f8ea5425 Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1323206 Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:27:57.579229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:27:57.580808 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8e41380c40e543fdb3c280c9f8ea5425"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8e41380c40e543fdb3c280c9f8ea5425", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8e41380c40e543fdb3c280c9f8ea5425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8e41380c40e543fdb3c280c9f8ea5425"}]}] Sep 19 12:27:57.580808 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1323206 Sep 19 12:27:57.580808 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 8e41380c40e543fdb3c280c9f8ea5425 Sep 19 12:27:57.580808 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1323206 Sep 19 12:27:57.580808 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-VolumesSnapshotsTestJSON-1323206-project Sep 19 12:27:57.580808 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:27:57.580808 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:27:57.580808 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 849a319e3db843218b2d825863814b79 Sep 19 12:27:57.580808 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1323206-project Sep 19 12:27:57.580808 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: Sep 19 12:27:57.580808 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Snapshot 3034278b-0850-45b3-8332-5ad88291042f could not be found. Sep 19 12:27:57.580808 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': '3034278b-0850-45b3-8332-5ad88291042f'} Sep 19 12:27:57.580808 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:27:57.581837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:57.581837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 19 12:27:57.581837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 19 12:27:57.581837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 19 12:27:57.581837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 19 12:27:57.581837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 19 12:27:57.581837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 19 12:27:57.581837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 12:27:57.581837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 12:27:57.581837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 12:27:57.581837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 12:27:57.581837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 12:27:57.581837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 12:27:57.581837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 12:27:57.581837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 12:27:57.581837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3034278b-0850-45b3-8332-5ad88291042f could not be found. (HTTP 404) (Request-ID: req-8167c9ae-a0e7-4b2b-af60-7a5560e6e0a3) Sep 19 12:27:57.581837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:57.581837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:57.583244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:57.583244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:57.583244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 19 12:27:57.583244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 19 12:27:57.583244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 12:27:57.583244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 12:27:57.583244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 19 12:27:57.583244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 19 12:27:57.583244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 12:27:57.583244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 12:27:57.583244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 19 12:27:57.583244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 19 12:27:57.583244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 19 12:27:57.583244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 19 12:27:57.583244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 19 12:27:57.583244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 19 12:27:57.583244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 12:27:57.583244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 12:27:57.583244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3034278b-0850-45b3-8332-5ad88291042f could not be found. Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 19 12:27:57.584650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:27:57.589113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3034278b-0850-45b3-8332-5ad88291042f could not be found. Sep 19 12:27:57.589113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:57.589113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:57.589113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:57.589113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:57.589113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:57.589113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:57.589113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:27:57.589113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:27:57.589113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3034278b-0850-45b3-8332-5ad88291042f could not be found. Sep 19 12:27:57.589113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:57.589113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-891b8769-675a-480b-9b42-ddb91e2a63d7 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Returning 404 to user: Snapshot 3034278b-0850-45b3-8332-5ad88291042f could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:27:57.589113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-891b8769-675a-480b-9b42-ddb91e2a63d7 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f" status: 404 len: 111 microversion: 2.1 time: 0.267769 Sep 19 12:27:57.589113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 114/231] 10.222.0.93 () {58 vars in 1251 bytes} [Mon Sep 19 12:27:57 2022] GET /compute/v2.1/os-snapshots/3034278b-0850-45b3-8332-5ad88291042f => generated 111 bytes in 269 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 12:27:57.590694 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ea7d4e3e-f4f2-4965-8792-fc41096b02a0 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Calling method '.version_select at 0x7f54b37c0ee0>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:57.908498 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ea7d4e3e-f4f2-4965-8792-fc41096b02a0 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/1702b153-1778-4a9e-8c5d-9065e5706662" status: 202 len: 0 microversion: 2.1 time: 0.322243 Sep 19 12:27:57.913162 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 118/232] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Sep 19 12:27:57 2022] DELETE /compute/v2.1/os-volumes/1702b153-1778-4a9e-8c5d-9065e5706662 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:27:57.918575 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-1bda3cab-d790-4d1a-b7e4-544063a099b4 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Calling method '.version_select at 0x7f54b38d8ca0>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:57.995810 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-1bda3cab-d790-4d1a-b7e4-544063a099b4 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/1702b153-1778-4a9e-8c5d-9065e5706662" status: 200 len: 345 microversion: 2.1 time: 0.081248 Sep 19 12:27:57.996370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 115/233] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Sep 19 12:27:57 2022] GET /compute/v2.1/os-volumes/1702b153-1778-4a9e-8c5d-9065e5706662 => generated 345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:27:59.011021 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-cd308405-0eeb-4c69-a123-da4c719225e3 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Calling method '.version_select at 0x7f54b37cf9d0>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:59.042338 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-cd308405-0eeb-4c69-a123-da4c719225e3 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] HTTP exception thrown: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-cd308405-0eeb-4c69-a123-da4c719225e3 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Request method failure captured: Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/os-volumes/1702b153-1778-4a9e-8c5d-9065e5706662 HTTP/1.1 Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKGBDjYPcCdNA-Tr8dI2uN_ZyriNN6UwbM54Bn1TsjFlqhB_PLPUkRZKmJcx0LK30h7GST2992GbMC1KlY3YfDHdaugCfkSTxVNYD7zacX5u8JmFDxNPKlgGQqxLdhuuBkvsGNFGnnb4jbwchd-_ojsPQgWuK_rwsYFt4Q7kz0N2uAf8 Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 8e41380c40e543fdb3c280c9f8ea5425 Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1323206 Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:27:59.044262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:27:59.045696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8e41380c40e543fdb3c280c9f8ea5425"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8e41380c40e543fdb3c280c9f8ea5425", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8e41380c40e543fdb3c280c9f8ea5425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8e41380c40e543fdb3c280c9f8ea5425"}]}] Sep 19 12:27:59.045696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1323206 Sep 19 12:27:59.045696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 8e41380c40e543fdb3c280c9f8ea5425 Sep 19 12:27:59.045696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1323206 Sep 19 12:27:59.045696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-VolumesSnapshotsTestJSON-1323206-project Sep 19 12:27:59.045696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:27:59.045696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:27:59.045696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: 849a319e3db843218b2d825863814b79 Sep 19 12:27:59.045696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1323206-project Sep 19 12:27:59.045696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: Sep 19 12:27:59.045696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. Sep 19 12:27:59.045696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': '1702b153-1778-4a9e-8c5d-9065e5706662'} Sep 19 12:27:59.045696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:27:59.046588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:59.046588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 12:27:59.046588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 12:27:59.046588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 12:27:59.046588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 12:27:59.046588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 12:27:59.046588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 12:27:59.046588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 12:27:59.046588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 12:27:59.046588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 12:27:59.046588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 12:27:59.046588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 12:27:59.046588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 12:27:59.046588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 12:27:59.046588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 12:27:59.046588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. (HTTP 404) (Request-ID: req-eb1d2b87-0a69-49be-9f6b-86001d7251e5) Sep 19 12:27:59.046588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.046588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:59.046588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.047826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:59.047826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 12:27:59.047826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 12:27:59.047826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 12:27:59.047826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 12:27:59.047826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 12:27:59.047826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 12:27:59.047826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 12:27:59.047826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 12:27:59.047826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 12:27:59.047826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 12:27:59.047826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 12:27:59.047826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 12:27:59.047826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 12:27:59.047826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 12:27:59.047826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 12:27:59.047826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 12:27:59.047826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 12:27:59.047826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 12:27:59.051260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 12:27:59.051260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 12:27:59.051260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 12:27:59.051260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 12:27:59.051260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. Sep 19 12:27:59.051260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.051260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:59.051260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.051260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:59.051260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:59.051260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:59.051260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:27:59.051260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:27:59.051260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 12:27:59.051260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 12:27:59.051260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:27:59.051260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:27:59.051260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 12:27:59.051260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:27:59.052456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. Sep 19 12:27:59.052456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.052456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:59.052456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.052456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:59.052456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:59.052456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:59.052456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:27:59.052456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:27:59.052456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. Sep 19 12:27:59.052456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.052456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-cd308405-0eeb-4c69-a123-da4c719225e3 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Returning 404 to user: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:27:59.052456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-cd308405-0eeb-4c69-a123-da4c719225e3 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/1702b153-1778-4a9e-8c5d-9065e5706662" status: 404 len: 109 microversion: 2.1 time: 0.039765 Sep 19 12:27:59.052456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 119/234] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Sep 19 12:27:59 2022] GET /compute/v2.1/os-volumes/1702b153-1778-4a9e-8c5d-9065e5706662 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:27:59.064247 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-1c54c114-1839-428b-9121-7ef993fd41a6 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Calling method '.version_select at 0x7f54b3822ee0>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:59.094625 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-1c54c114-1839-428b-9121-7ef993fd41a6 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] HTTP exception thrown: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-1c54c114-1839-428b-9121-7ef993fd41a6 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Request method failure captured: Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: DELETE /compute/v2.1/os-volumes/1702b153-1778-4a9e-8c5d-9065e5706662 HTTP/1.1 Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKGBDjYPcCdNA-Tr8dI2uN_ZyriNN6UwbM54Bn1TsjFlqhB_PLPUkRZKmJcx0LK30h7GST2992GbMC1KlY3YfDHdaugCfkSTxVNYD7zacX5u8JmFDxNPKlgGQqxLdhuuBkvsGNFGnnb4jbwchd-_ojsPQgWuK_rwsYFt4Q7kz0N2uAf8 Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 8e41380c40e543fdb3c280c9f8ea5425 Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1323206 Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:27:59.096911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:27:59.098472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8e41380c40e543fdb3c280c9f8ea5425"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8e41380c40e543fdb3c280c9f8ea5425", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8e41380c40e543fdb3c280c9f8ea5425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8e41380c40e543fdb3c280c9f8ea5425"}]}] Sep 19 12:27:59.098472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1323206 Sep 19 12:27:59.098472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 8e41380c40e543fdb3c280c9f8ea5425 Sep 19 12:27:59.098472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1323206 Sep 19 12:27:59.098472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-VolumesSnapshotsTestJSON-1323206-project Sep 19 12:27:59.098472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:27:59.098472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:27:59.098472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 849a319e3db843218b2d825863814b79 Sep 19 12:27:59.098472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1323206-project Sep 19 12:27:59.098472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: Sep 19 12:27:59.098472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. Sep 19 12:27:59.098472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': '1702b153-1778-4a9e-8c5d-9065e5706662'} Sep 19 12:27:59.098472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:27:59.099415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:59.099415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 12:27:59.099415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 12:27:59.099415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 12:27:59.099415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 12:27:59.099415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 12:27:59.099415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 12:27:59.099415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 12:27:59.099415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 12:27:59.099415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 12:27:59.099415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 12:27:59.099415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 12:27:59.099415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 12:27:59.099415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 12:27:59.099415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 12:27:59.099415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. (HTTP 404) (Request-ID: req-c4ac53bb-6d41-4ddc-907d-c2ebb7887fac) Sep 19 12:27:59.099415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.099415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:59.099415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.101411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:59.101411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 12:27:59.101411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 12:27:59.101411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 12:27:59.101411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 12:27:59.101411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 12:27:59.101411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 12:27:59.101411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 12:27:59.101411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 12:27:59.101411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 12:27:59.101411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 12:27:59.101411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 12:27:59.101411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 12:27:59.101411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 12:27:59.101411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 12:27:59.101411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 12:27:59.101411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 12:27:59.101411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 12:27:59.101411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 12:27:59.102717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 12:27:59.102717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 12:27:59.102717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 12:27:59.102717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 12:27:59.102717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. Sep 19 12:27:59.102717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.102717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:59.102717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.102717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:59.102717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:59.102717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:59.102717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:27:59.102717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:27:59.102717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 12:27:59.102717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 12:27:59.102717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:27:59.102717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:27:59.102717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 12:27:59.102717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:27:59.104032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. Sep 19 12:27:59.104032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.104032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:59.104032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.104032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:59.104032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:59.104032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:59.104032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:27:59.104032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:27:59.104032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. Sep 19 12:27:59.104032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.104032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-1c54c114-1839-428b-9121-7ef993fd41a6 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Returning 404 to user: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:27:59.104032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-1c54c114-1839-428b-9121-7ef993fd41a6 tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/1702b153-1778-4a9e-8c5d-9065e5706662" status: 404 len: 109 microversion: 2.1 time: 0.038108 Sep 19 12:27:59.104032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 116/235] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Sep 19 12:27:59 2022] DELETE /compute/v2.1/os-volumes/1702b153-1778-4a9e-8c5d-9065e5706662 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 12:27:59.114851 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d783e100-691a-4853-a8d4-119584095bdb tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Calling method '.version_select at 0x7f54b42b2dc0>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:59.143909 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-d783e100-691a-4853-a8d4-119584095bdb tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] HTTP exception thrown: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d783e100-691a-4853-a8d4-119584095bdb tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Request method failure captured: Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/os-volumes/1702b153-1778-4a9e-8c5d-9065e5706662 HTTP/1.1 Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKGBDjYPcCdNA-Tr8dI2uN_ZyriNN6UwbM54Bn1TsjFlqhB_PLPUkRZKmJcx0LK30h7GST2992GbMC1KlY3YfDHdaugCfkSTxVNYD7zacX5u8JmFDxNPKlgGQqxLdhuuBkvsGNFGnnb4jbwchd-_ojsPQgWuK_rwsYFt4Q7kz0N2uAf8 Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 8e41380c40e543fdb3c280c9f8ea5425 Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1323206 Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:27:59.145887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:27:59.147243 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8e41380c40e543fdb3c280c9f8ea5425"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8e41380c40e543fdb3c280c9f8ea5425", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8e41380c40e543fdb3c280c9f8ea5425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8e41380c40e543fdb3c280c9f8ea5425"}]}] Sep 19 12:27:59.147243 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1323206 Sep 19 12:27:59.147243 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 8e41380c40e543fdb3c280c9f8ea5425 Sep 19 12:27:59.147243 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1323206 Sep 19 12:27:59.147243 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-VolumesSnapshotsTestJSON-1323206-project Sep 19 12:27:59.147243 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:27:59.147243 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:27:59.147243 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: 849a319e3db843218b2d825863814b79 Sep 19 12:27:59.147243 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1323206-project Sep 19 12:27:59.147243 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: Sep 19 12:27:59.147243 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. Sep 19 12:27:59.147243 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': '1702b153-1778-4a9e-8c5d-9065e5706662'} Sep 19 12:27:59.147243 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:27:59.147991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:59.147991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 12:27:59.147991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 12:27:59.147991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 12:27:59.147991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 12:27:59.147991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 12:27:59.147991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 12:27:59.147991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 12:27:59.147991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 12:27:59.147991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 12:27:59.147991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 12:27:59.147991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 12:27:59.147991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 12:27:59.147991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 12:27:59.147991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 12:27:59.147991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. (HTTP 404) (Request-ID: req-8a1b1788-f506-4fa3-97c6-546b3dfc40e4) Sep 19 12:27:59.147991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.147991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:59.147991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.149042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:59.149042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 12:27:59.149042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 12:27:59.149042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 12:27:59.149042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 12:27:59.149042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 12:27:59.149042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 12:27:59.149042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 12:27:59.149042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 12:27:59.149042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 12:27:59.149042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 12:27:59.149042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 12:27:59.149042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 12:27:59.149042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 12:27:59.149042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 12:27:59.149042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 12:27:59.149042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 12:27:59.149042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 12:27:59.149042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 12:27:59.150084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 12:27:59.150084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 12:27:59.150084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 12:27:59.150084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 12:27:59.150084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. Sep 19 12:27:59.150084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.150084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:59.150084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.150084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:59.150084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:59.150084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:59.150084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:27:59.150084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:27:59.150084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 12:27:59.150084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 12:27:59.150084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:27:59.150084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:27:59.150084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 12:27:59.150084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:27:59.151054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. Sep 19 12:27:59.151054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.151054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:59.151054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.151054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:59.151054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:59.151054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:59.151054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:27:59.151054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:27:59.151054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. Sep 19 12:27:59.151054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:27:59.151054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d783e100-691a-4853-a8d4-119584095bdb tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] Returning 404 to user: Volume 1702b153-1778-4a9e-8c5d-9065e5706662 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:27:59.151054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d783e100-691a-4853-a8d4-119584095bdb tempest-VolumesSnapshotsTestJSON-1323206 tempest-VolumesSnapshotsTestJSON-1323206-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/1702b153-1778-4a9e-8c5d-9065e5706662" status: 404 len: 109 microversion: 2.1 time: 0.038099 Sep 19 12:27:59.151054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 120/236] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Sep 19 12:27:59 2022] GET /compute/v2.1/os-volumes/1702b153-1778-4a9e-8c5d-9065e5706662 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:27:59.329884 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-0e0c34c8-9647-4da5-9db9-63618c5fc4f8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:27:59.332210 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-0e0c34c8-9647-4da5-9db9-63618c5fc4f8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:59.339770 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0e0c34c8-9647-4da5-9db9-63618c5fc4f8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:59.340258 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0e0c34c8-9647-4da5-9db9-63618c5fc4f8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:59.340719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0e0c34c8-9647-4da5-9db9-63618c5fc4f8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:59.341417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0e0c34c8-9647-4da5-9db9-63618c5fc4f8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:59.341863 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0e0c34c8-9647-4da5-9db9-63618c5fc4f8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:59.342282 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0e0c34c8-9647-4da5-9db9-63618c5fc4f8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:59.409769 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.objects.instance [None req-0e0c34c8-9647-4da5-9db9-63618c5fc4f8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lazy-loading 'flavor' on Instance uuid aa0ab2f3-883e-4b45-95d1-d0f8895fc401 {{(pid=121429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:27:59.796501 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-0e0c34c8-9647-4da5-9db9-63618c5fc4f8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "POST /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401/action" status: 200 len: 32 microversion: 2.1 time: 0.471794 Sep 19 12:27:59.797334 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 117/237] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Sep 19 12:27:59 2022] POST /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401/action => generated 32 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 12:27:59.815340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-44162cc1-00ce-4e0e-8d3d-1dc141a14bac tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:59.816280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-44162cc1-00ce-4e0e-8d3d-1dc141a14bac tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:59.824486 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-44162cc1-00ce-4e0e-8d3d-1dc141a14bac tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:59.825103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-44162cc1-00ce-4e0e-8d3d-1dc141a14bac tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:59.825601 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-44162cc1-00ce-4e0e-8d3d-1dc141a14bac tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:59.826362 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-44162cc1-00ce-4e0e-8d3d-1dc141a14bac tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:59.826877 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-44162cc1-00ce-4e0e-8d3d-1dc141a14bac tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:59.827362 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-44162cc1-00ce-4e0e-8d3d-1dc141a14bac tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:00.049594 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-44162cc1-00ce-4e0e-8d3d-1dc141a14bac tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:00.063966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-44162cc1-00ce-4e0e-8d3d-1dc141a14bac tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.253261 Sep 19 12:28:00.066320 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 121/238] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:59 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:01.087950 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-8a3398fc-2d5f-46a5-b91c-0c55e8a4f163 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:01.088787 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-8a3398fc-2d5f-46a5-b91c-0c55e8a4f163 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:01.094935 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8a3398fc-2d5f-46a5-b91c-0c55e8a4f163 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:01.095560 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8a3398fc-2d5f-46a5-b91c-0c55e8a4f163 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:01.096063 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8a3398fc-2d5f-46a5-b91c-0c55e8a4f163 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:01.096806 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8a3398fc-2d5f-46a5-b91c-0c55e8a4f163 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:01.097300 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8a3398fc-2d5f-46a5-b91c-0c55e8a4f163 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:01.097678 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8a3398fc-2d5f-46a5-b91c-0c55e8a4f163 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:01.277963 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8a3398fc-2d5f-46a5-b91c-0c55e8a4f163 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:01.287308 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-8a3398fc-2d5f-46a5-b91c-0c55e8a4f163 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.202529 Sep 19 12:28:01.287308 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 118/239] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:01 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:02.311579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-4e17b0f4-9b7b-4a85-b2ae-699454eb4762 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:02.312268 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-4e17b0f4-9b7b-4a85-b2ae-699454eb4762 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:02.319871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4e17b0f4-9b7b-4a85-b2ae-699454eb4762 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:02.320250 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4e17b0f4-9b7b-4a85-b2ae-699454eb4762 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:02.321316 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4e17b0f4-9b7b-4a85-b2ae-699454eb4762 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:02.322161 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4e17b0f4-9b7b-4a85-b2ae-699454eb4762 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:02.322981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4e17b0f4-9b7b-4a85-b2ae-699454eb4762 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:02.331962 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4e17b0f4-9b7b-4a85-b2ae-699454eb4762 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:02.485229 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-4e17b0f4-9b7b-4a85-b2ae-699454eb4762 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:02.494115 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-4e17b0f4-9b7b-4a85-b2ae-699454eb4762 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.187248 Sep 19 12:28:02.507986 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 122/240] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:02 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:03.517843 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-a9d17587-3001-4a5e-be03-5428cad91bed tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:03.518542 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-a9d17587-3001-4a5e-be03-5428cad91bed tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:03.524583 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a9d17587-3001-4a5e-be03-5428cad91bed tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:03.525191 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a9d17587-3001-4a5e-be03-5428cad91bed tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:03.525703 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a9d17587-3001-4a5e-be03-5428cad91bed tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:03.526482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a9d17587-3001-4a5e-be03-5428cad91bed tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:03.526934 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a9d17587-3001-4a5e-be03-5428cad91bed tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:03.527346 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a9d17587-3001-4a5e-be03-5428cad91bed tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:03.664178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-a9d17587-3001-4a5e-be03-5428cad91bed tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:03.672057 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-a9d17587-3001-4a5e-be03-5428cad91bed tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.158800 Sep 19 12:28:03.672712 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 119/241] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:03 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:04.696964 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c2d1c53b-1509-4ce9-b3a9-952ad4eab3e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:04.697486 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c2d1c53b-1509-4ce9-b3a9-952ad4eab3e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:04.705393 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c2d1c53b-1509-4ce9-b3a9-952ad4eab3e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:04.705877 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c2d1c53b-1509-4ce9-b3a9-952ad4eab3e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:04.706307 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c2d1c53b-1509-4ce9-b3a9-952ad4eab3e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:04.707016 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c2d1c53b-1509-4ce9-b3a9-952ad4eab3e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:04.707488 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c2d1c53b-1509-4ce9-b3a9-952ad4eab3e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:04.707952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c2d1c53b-1509-4ce9-b3a9-952ad4eab3e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:04.865095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c2d1c53b-1509-4ce9-b3a9-952ad4eab3e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:04.878770 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c2d1c53b-1509-4ce9-b3a9-952ad4eab3e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.186386 Sep 19 12:28:04.880013 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 123/242] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:04 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:05.908120 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-d3d4535a-3f7e-4d75-961e-03721372e8ad tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:05.909318 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-d3d4535a-3f7e-4d75-961e-03721372e8ad tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:05.919982 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3d4535a-3f7e-4d75-961e-03721372e8ad tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:05.920899 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3d4535a-3f7e-4d75-961e-03721372e8ad tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:05.921710 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3d4535a-3f7e-4d75-961e-03721372e8ad tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:05.922981 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3d4535a-3f7e-4d75-961e-03721372e8ad tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:05.923826 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3d4535a-3f7e-4d75-961e-03721372e8ad tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:05.924577 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3d4535a-3f7e-4d75-961e-03721372e8ad tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:06.071555 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-d3d4535a-3f7e-4d75-961e-03721372e8ad tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:06.082198 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-d3d4535a-3f7e-4d75-961e-03721372e8ad tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.181356 Sep 19 12:28:06.083118 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 120/243] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:05 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:07.106694 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-3fe3935c-c1d1-402d-9ca8-c3354a79b2e3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:07.107651 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-3fe3935c-c1d1-402d-9ca8-c3354a79b2e3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:07.114398 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3fe3935c-c1d1-402d-9ca8-c3354a79b2e3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:07.115116 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3fe3935c-c1d1-402d-9ca8-c3354a79b2e3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:07.115825 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3fe3935c-c1d1-402d-9ca8-c3354a79b2e3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:07.117786 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3fe3935c-c1d1-402d-9ca8-c3354a79b2e3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:07.118412 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3fe3935c-c1d1-402d-9ca8-c3354a79b2e3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:07.118850 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3fe3935c-c1d1-402d-9ca8-c3354a79b2e3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:07.122068 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=82 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:07.278182 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-3fe3935c-c1d1-402d-9ca8-c3354a79b2e3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:07.285889 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-3fe3935c-c1d1-402d-9ca8-c3354a79b2e3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.183279 Sep 19 12:28:07.286523 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 124/244] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:07 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:28:08.311192 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9078f5a2-f774-4c4b-a19c-fbb554c07f82 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:08.311934 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9078f5a2-f774-4c4b-a19c-fbb554c07f82 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:08.320219 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9078f5a2-f774-4c4b-a19c-fbb554c07f82 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:08.320831 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9078f5a2-f774-4c4b-a19c-fbb554c07f82 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:08.321380 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9078f5a2-f774-4c4b-a19c-fbb554c07f82 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:08.322182 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9078f5a2-f774-4c4b-a19c-fbb554c07f82 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:08.322849 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9078f5a2-f774-4c4b-a19c-fbb554c07f82 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:08.323350 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9078f5a2-f774-4c4b-a19c-fbb554c07f82 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:08.481950 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9078f5a2-f774-4c4b-a19c-fbb554c07f82 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:08.490472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9078f5a2-f774-4c4b-a19c-fbb554c07f82 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.183432 Sep 19 12:28:08.491547 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 121/245] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:08 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:09.515949 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-fac53477-2c02-44f7-bff8-4eee59dd6c2f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:09.516576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-fac53477-2c02-44f7-bff8-4eee59dd6c2f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:09.524138 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fac53477-2c02-44f7-bff8-4eee59dd6c2f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:09.524645 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fac53477-2c02-44f7-bff8-4eee59dd6c2f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:09.525088 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fac53477-2c02-44f7-bff8-4eee59dd6c2f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:09.525796 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fac53477-2c02-44f7-bff8-4eee59dd6c2f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:09.526269 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fac53477-2c02-44f7-bff8-4eee59dd6c2f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:09.526678 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fac53477-2c02-44f7-bff8-4eee59dd6c2f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:09.660516 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-fac53477-2c02-44f7-bff8-4eee59dd6c2f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:09.668304 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-fac53477-2c02-44f7-bff8-4eee59dd6c2f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.157152 Sep 19 12:28:09.668921 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 125/246] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:09 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:10.064423 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-8cafc15b-b951-4eef-b45f-2ab46d69faa4 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:10.064962 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-8cafc15b-b951-4eef-b45f-2ab46d69faa4 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:10.071669 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8cafc15b-b951-4eef-b45f-2ab46d69faa4 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:10.072139 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8cafc15b-b951-4eef-b45f-2ab46d69faa4 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:10.072565 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8cafc15b-b951-4eef-b45f-2ab46d69faa4 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:10.073338 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8cafc15b-b951-4eef-b45f-2ab46d69faa4 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:10.073786 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8cafc15b-b951-4eef-b45f-2ab46d69faa4 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:10.074205 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8cafc15b-b951-4eef-b45f-2ab46d69faa4 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:10.096684 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-8cafc15b-b951-4eef-b45f-2ab46d69faa4 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/ips" status: 200 len: 145 microversion: 2.1 time: 0.036032 Sep 19 12:28:10.097159 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 122/247] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Sep 19 12:28:10 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:28:10.691356 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-0e2c49bc-0b05-4b90-a65f-1b39f2a25325 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:10.691877 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-0e2c49bc-0b05-4b90-a65f-1b39f2a25325 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:10.698428 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0e2c49bc-0b05-4b90-a65f-1b39f2a25325 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:10.698906 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0e2c49bc-0b05-4b90-a65f-1b39f2a25325 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:10.699332 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0e2c49bc-0b05-4b90-a65f-1b39f2a25325 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:10.700045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0e2c49bc-0b05-4b90-a65f-1b39f2a25325 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:10.700486 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0e2c49bc-0b05-4b90-a65f-1b39f2a25325 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:10.700931 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0e2c49bc-0b05-4b90-a65f-1b39f2a25325 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:10.832264 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-0e2c49bc-0b05-4b90-a65f-1b39f2a25325 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:10.840354 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-0e2c49bc-0b05-4b90-a65f-1b39f2a25325 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.152959 Sep 19 12:28:10.841225 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 126/248] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:10 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:11.864335 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-0c008027-60d8-456a-8ad0-9db64ac51df6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:11.865099 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-0c008027-60d8-456a-8ad0-9db64ac51df6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:11.867689 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=34 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:11.872462 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0c008027-60d8-456a-8ad0-9db64ac51df6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:11.872985 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0c008027-60d8-456a-8ad0-9db64ac51df6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:11.873421 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0c008027-60d8-456a-8ad0-9db64ac51df6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:11.874116 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0c008027-60d8-456a-8ad0-9db64ac51df6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:11.874570 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0c008027-60d8-456a-8ad0-9db64ac51df6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:11.875110 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0c008027-60d8-456a-8ad0-9db64ac51df6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:12.010781 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-0c008027-60d8-456a-8ad0-9db64ac51df6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:12.018676 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-0c008027-60d8-456a-8ad0-9db64ac51df6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.158271 Sep 19 12:28:12.019231 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 123/249] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:11 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:13.044452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a5448c5c-b41c-4705-9eb2-9ba0a2302764 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:13.045860 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a5448c5c-b41c-4705-9eb2-9ba0a2302764 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:13.053788 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a5448c5c-b41c-4705-9eb2-9ba0a2302764 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:13.054737 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a5448c5c-b41c-4705-9eb2-9ba0a2302764 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:13.055382 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a5448c5c-b41c-4705-9eb2-9ba0a2302764 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:13.056114 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a5448c5c-b41c-4705-9eb2-9ba0a2302764 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:13.056564 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a5448c5c-b41c-4705-9eb2-9ba0a2302764 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:13.057229 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a5448c5c-b41c-4705-9eb2-9ba0a2302764 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:13.209948 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-a5448c5c-b41c-4705-9eb2-9ba0a2302764 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:13.218573 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a5448c5c-b41c-4705-9eb2-9ba0a2302764 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.179928 Sep 19 12:28:13.219159 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 127/250] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:13 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:14.242755 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c3e13796-bc8e-4189-a7c4-d2e91b55e5f6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:14.243417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c3e13796-bc8e-4189-a7c4-d2e91b55e5f6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:14.249822 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c3e13796-bc8e-4189-a7c4-d2e91b55e5f6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:14.250317 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c3e13796-bc8e-4189-a7c4-d2e91b55e5f6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:14.250760 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c3e13796-bc8e-4189-a7c4-d2e91b55e5f6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:14.251510 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c3e13796-bc8e-4189-a7c4-d2e91b55e5f6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:14.252027 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c3e13796-bc8e-4189-a7c4-d2e91b55e5f6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:14.252454 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c3e13796-bc8e-4189-a7c4-d2e91b55e5f6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:14.403207 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c3e13796-bc8e-4189-a7c4-d2e91b55e5f6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:14.412229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c3e13796-bc8e-4189-a7c4-d2e91b55e5f6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.174260 Sep 19 12:28:14.412845 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 124/251] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:14 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:15.435852 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-48fc2214-1c11-4b69-a9d4-bcf6e02f3ce0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:15.436454 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-48fc2214-1c11-4b69-a9d4-bcf6e02f3ce0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:15.443321 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-48fc2214-1c11-4b69-a9d4-bcf6e02f3ce0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:15.443794 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-48fc2214-1c11-4b69-a9d4-bcf6e02f3ce0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:15.444333 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-48fc2214-1c11-4b69-a9d4-bcf6e02f3ce0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:15.445223 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-48fc2214-1c11-4b69-a9d4-bcf6e02f3ce0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:15.445822 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-48fc2214-1c11-4b69-a9d4-bcf6e02f3ce0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:15.446348 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-48fc2214-1c11-4b69-a9d4-bcf6e02f3ce0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:15.597167 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-48fc2214-1c11-4b69-a9d4-bcf6e02f3ce0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:15.606169 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-48fc2214-1c11-4b69-a9d4-bcf6e02f3ce0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.174307 Sep 19 12:28:15.606971 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 128/252] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:15 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:16.604204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-600cd123-019f-4906-9ca5-7f701c598a4d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31d137ff-b153-4b85-94cc-5b327cbe7332"}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:28:16.606732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-600cd123-019f-4906-9ca5-7f701c598a4d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:16.612845 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-600cd123-019f-4906-9ca5-7f701c598a4d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:16.613330 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-600cd123-019f-4906-9ca5-7f701c598a4d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:16.613765 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-600cd123-019f-4906-9ca5-7f701c598a4d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:16.614453 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-600cd123-019f-4906-9ca5-7f701c598a4d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:16.614904 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-600cd123-019f-4906-9ca5-7f701c598a4d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:16.615337 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-600cd123-019f-4906-9ca5-7f701c598a4d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:16.630527 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a5211ef4-6a9e-430b-b6fd-f7c174a8f603 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:16.631216 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a5211ef4-6a9e-430b-b6fd-f7c174a8f603 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:16.637876 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a5211ef4-6a9e-430b-b6fd-f7c174a8f603 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:16.638555 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a5211ef4-6a9e-430b-b6fd-f7c174a8f603 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:16.639017 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a5211ef4-6a9e-430b-b6fd-f7c174a8f603 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:16.639958 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a5211ef4-6a9e-430b-b6fd-f7c174a8f603 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:16.640423 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a5211ef4-6a9e-430b-b6fd-f7c174a8f603 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:16.640876 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a5211ef4-6a9e-430b-b6fd-f7c174a8f603 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:16.800066 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-a5211ef4-6a9e-430b-b6fd-f7c174a8f603 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:16.807890 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a5211ef4-6a9e-430b-b6fd-f7c174a8f603 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.181488 Sep 19 12:28:16.808456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 129/253] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:16 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:28:16.888270 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:17.761616 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-600cd123-019f-4906-9ca5-7f701c598a4d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "POST /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.161564 Sep 19 12:28:17.762664 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 125/254] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Sep 19 12:28:16 2022] POST /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/os-volume_attachments => generated 194 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:28:17.835013 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-83aa4470-6917-4d2c-875a-4cb43e5e0f10 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:17.835838 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-83aa4470-6917-4d2c-875a-4cb43e5e0f10 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:17.843006 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-83aa4470-6917-4d2c-875a-4cb43e5e0f10 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:17.843485 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-83aa4470-6917-4d2c-875a-4cb43e5e0f10 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:17.843909 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-83aa4470-6917-4d2c-875a-4cb43e5e0f10 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:17.844640 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-83aa4470-6917-4d2c-875a-4cb43e5e0f10 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:17.845077 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-83aa4470-6917-4d2c-875a-4cb43e5e0f10 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:17.845490 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-83aa4470-6917-4d2c-875a-4cb43e5e0f10 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:18.000428 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-83aa4470-6917-4d2c-875a-4cb43e5e0f10 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:18.008412 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-83aa4470-6917-4d2c-875a-4cb43e5e0f10 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.180694 Sep 19 12:28:18.017519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 130/255] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:17 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:19.036504 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-d1c296fb-2e6e-4f0b-9ca6-f73bb34ae523 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:19.037834 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-d1c296fb-2e6e-4f0b-9ca6-f73bb34ae523 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:19.049056 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d1c296fb-2e6e-4f0b-9ca6-f73bb34ae523 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:19.049991 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d1c296fb-2e6e-4f0b-9ca6-f73bb34ae523 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:19.050771 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d1c296fb-2e6e-4f0b-9ca6-f73bb34ae523 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:19.052042 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d1c296fb-2e6e-4f0b-9ca6-f73bb34ae523 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:19.052888 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d1c296fb-2e6e-4f0b-9ca6-f73bb34ae523 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:19.053629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d1c296fb-2e6e-4f0b-9ca6-f73bb34ae523 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:19.275252 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-d1c296fb-2e6e-4f0b-9ca6-f73bb34ae523 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:19.297165 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-d1c296fb-2e6e-4f0b-9ca6-f73bb34ae523 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.265077 Sep 19 12:28:19.297165 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 126/256] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:19 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:20.320936 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-28383b38-29b0-4c06-ad63-c1d9454116ec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:20.321328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-28383b38-29b0-4c06-ad63-c1d9454116ec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:20.328462 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-28383b38-29b0-4c06-ad63-c1d9454116ec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:20.329070 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-28383b38-29b0-4c06-ad63-c1d9454116ec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:20.329798 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-28383b38-29b0-4c06-ad63-c1d9454116ec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:20.330825 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-28383b38-29b0-4c06-ad63-c1d9454116ec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:20.331456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-28383b38-29b0-4c06-ad63-c1d9454116ec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:20.332062 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-28383b38-29b0-4c06-ad63-c1d9454116ec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:20.481261 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-28383b38-29b0-4c06-ad63-c1d9454116ec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:20.490328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-28383b38-29b0-4c06-ad63-c1d9454116ec tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.176237 Sep 19 12:28:20.495539 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 131/257] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:20 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:21.519639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-414233ff-df76-4bbb-9e05-85ded52e30f5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:21.520292 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-414233ff-df76-4bbb-9e05-85ded52e30f5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:21.534192 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-414233ff-df76-4bbb-9e05-85ded52e30f5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:21.536018 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-414233ff-df76-4bbb-9e05-85ded52e30f5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:21.538358 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-414233ff-df76-4bbb-9e05-85ded52e30f5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:21.539304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-414233ff-df76-4bbb-9e05-85ded52e30f5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:21.539836 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-414233ff-df76-4bbb-9e05-85ded52e30f5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:21.540282 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-414233ff-df76-4bbb-9e05-85ded52e30f5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:21.680431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-414233ff-df76-4bbb-9e05-85ded52e30f5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:21.689256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-414233ff-df76-4bbb-9e05-85ded52e30f5 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.177420 Sep 19 12:28:21.690052 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 127/258] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:21 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:22.714816 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-70795d2b-fc30-4d2c-9f2b-3b47cfddd6ca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:22.715421 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-70795d2b-fc30-4d2c-9f2b-3b47cfddd6ca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:22.722031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-70795d2b-fc30-4d2c-9f2b-3b47cfddd6ca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:22.722694 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-70795d2b-fc30-4d2c-9f2b-3b47cfddd6ca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:22.723279 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-70795d2b-fc30-4d2c-9f2b-3b47cfddd6ca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:22.724156 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-70795d2b-fc30-4d2c-9f2b-3b47cfddd6ca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:22.724651 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-70795d2b-fc30-4d2c-9f2b-3b47cfddd6ca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:22.725081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-70795d2b-fc30-4d2c-9f2b-3b47cfddd6ca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:22.860035 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-70795d2b-fc30-4d2c-9f2b-3b47cfddd6ca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:22.883033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-70795d2b-fc30-4d2c-9f2b-3b47cfddd6ca tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.162454 Sep 19 12:28:22.883033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 132/259] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:22 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:23.896350 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3fbaacdb-93c0-4afc-9ab0-673228f756de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:23.897063 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3fbaacdb-93c0-4afc-9ab0-673228f756de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:23.904322 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3fbaacdb-93c0-4afc-9ab0-673228f756de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:23.904951 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3fbaacdb-93c0-4afc-9ab0-673228f756de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:23.907759 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3fbaacdb-93c0-4afc-9ab0-673228f756de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:23.907759 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3fbaacdb-93c0-4afc-9ab0-673228f756de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:23.907759 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3fbaacdb-93c0-4afc-9ab0-673228f756de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:23.907759 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3fbaacdb-93c0-4afc-9ab0-673228f756de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:24.049570 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3fbaacdb-93c0-4afc-9ab0-673228f756de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:24.059970 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3fbaacdb-93c0-4afc-9ab0-673228f756de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.168007 Sep 19 12:28:24.060869 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 128/260] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:23 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:25.086797 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-7863439e-8321-4ed9-8b0c-a83985d1204d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:25.087663 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-7863439e-8321-4ed9-8b0c-a83985d1204d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:25.094497 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7863439e-8321-4ed9-8b0c-a83985d1204d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:25.095379 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7863439e-8321-4ed9-8b0c-a83985d1204d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:25.096432 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7863439e-8321-4ed9-8b0c-a83985d1204d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:25.097920 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7863439e-8321-4ed9-8b0c-a83985d1204d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:25.098534 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7863439e-8321-4ed9-8b0c-a83985d1204d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:25.098965 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7863439e-8321-4ed9-8b0c-a83985d1204d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:25.254797 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-7863439e-8321-4ed9-8b0c-a83985d1204d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:25.263300 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-7863439e-8321-4ed9-8b0c-a83985d1204d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.181990 Sep 19 12:28:25.263872 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 133/261] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:25 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:26.290146 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-68d0fffb-2c6a-40b3-9d9a-79bcf6ffe8a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:26.291742 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-68d0fffb-2c6a-40b3-9d9a-79bcf6ffe8a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:26.301105 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-68d0fffb-2c6a-40b3-9d9a-79bcf6ffe8a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:26.301756 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-68d0fffb-2c6a-40b3-9d9a-79bcf6ffe8a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:26.302200 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-68d0fffb-2c6a-40b3-9d9a-79bcf6ffe8a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:26.303007 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-68d0fffb-2c6a-40b3-9d9a-79bcf6ffe8a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:26.303486 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-68d0fffb-2c6a-40b3-9d9a-79bcf6ffe8a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:26.304750 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-68d0fffb-2c6a-40b3-9d9a-79bcf6ffe8a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:26.449956 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-68d0fffb-2c6a-40b3-9d9a-79bcf6ffe8a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:26.459256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-68d0fffb-2c6a-40b3-9d9a-79bcf6ffe8a8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.175436 Sep 19 12:28:26.459898 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 129/262] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:26 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:26.519886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-9f67f354-2254-47da-85be-9e4639d28b2d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:28:26.527199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9f67f354-2254-47da-85be-9e4639d28b2d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:26.527680 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9f67f354-2254-47da-85be-9e4639d28b2d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:26.528115 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9f67f354-2254-47da-85be-9e4639d28b2d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:26.589179 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-9f67f354-2254-47da-85be-9e4639d28b2d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Going to try to stop instance {{(pid=121428) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 12:28:26.863361 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-9f67f354-2254-47da-85be-9e4639d28b2d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "POST /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/action" status: 202 len: 0 microversion: 2.1 time: 0.347323 Sep 19 12:28:26.864011 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 134/263] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Sep 19 12:28:26 2022] POST /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:28:26.872857 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-6048c5dc-ad17-4e73-bb18-ee03582190b9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:26.873488 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-6048c5dc-ad17-4e73-bb18-ee03582190b9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:26.879520 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6048c5dc-ad17-4e73-bb18-ee03582190b9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:26.880001 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6048c5dc-ad17-4e73-bb18-ee03582190b9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:26.880433 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6048c5dc-ad17-4e73-bb18-ee03582190b9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:26.881402 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6048c5dc-ad17-4e73-bb18-ee03582190b9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:26.881864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6048c5dc-ad17-4e73-bb18-ee03582190b9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:26.882979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6048c5dc-ad17-4e73-bb18-ee03582190b9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:27.017485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-6048c5dc-ad17-4e73-bb18-ee03582190b9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:27.033013 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-6048c5dc-ad17-4e73-bb18-ee03582190b9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1722 microversion: 2.1 time: 0.164129 Sep 19 12:28:27.033609 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 130/264] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:26 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:28:27.484328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-34a6f3a3-ccd3-4bac-b304-983f5175aec8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:27.485058 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-34a6f3a3-ccd3-4bac-b304-983f5175aec8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:27.491945 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-34a6f3a3-ccd3-4bac-b304-983f5175aec8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:27.492435 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-34a6f3a3-ccd3-4bac-b304-983f5175aec8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:27.492898 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-34a6f3a3-ccd3-4bac-b304-983f5175aec8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:27.493594 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-34a6f3a3-ccd3-4bac-b304-983f5175aec8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:27.494045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-34a6f3a3-ccd3-4bac-b304-983f5175aec8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:27.494467 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-34a6f3a3-ccd3-4bac-b304-983f5175aec8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:27.631814 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-34a6f3a3-ccd3-4bac-b304-983f5175aec8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:27.640182 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-34a6f3a3-ccd3-4bac-b304-983f5175aec8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.160929 Sep 19 12:28:27.640923 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 135/265] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:27 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:28.057625 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c7cbe934-520b-416e-9b5b-dfaa6402a728 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:28.058331 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c7cbe934-520b-416e-9b5b-dfaa6402a728 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:28.065384 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c7cbe934-520b-416e-9b5b-dfaa6402a728 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:28.066117 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c7cbe934-520b-416e-9b5b-dfaa6402a728 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:28.066554 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c7cbe934-520b-416e-9b5b-dfaa6402a728 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:28.067249 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c7cbe934-520b-416e-9b5b-dfaa6402a728 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:28.067854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c7cbe934-520b-416e-9b5b-dfaa6402a728 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:28.068478 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c7cbe934-520b-416e-9b5b-dfaa6402a728 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:28.212204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c7cbe934-520b-416e-9b5b-dfaa6402a728 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:28.232730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c7cbe934-520b-416e-9b5b-dfaa6402a728 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1722 microversion: 2.1 time: 0.167234 Sep 19 12:28:28.232730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 131/266] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:28 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:28.665389 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c247d479-33e1-4361-b06b-400d0b819091 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:28.665915 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c247d479-33e1-4361-b06b-400d0b819091 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:28.668542 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=32 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:28.673386 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c247d479-33e1-4361-b06b-400d0b819091 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:28.673873 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c247d479-33e1-4361-b06b-400d0b819091 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:28.674303 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c247d479-33e1-4361-b06b-400d0b819091 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:28.675000 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c247d479-33e1-4361-b06b-400d0b819091 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:28.675446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c247d479-33e1-4361-b06b-400d0b819091 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:28.675866 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c247d479-33e1-4361-b06b-400d0b819091 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:28.813718 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c247d479-33e1-4361-b06b-400d0b819091 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:28.837169 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c247d479-33e1-4361-b06b-400d0b819091 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.176130 Sep 19 12:28:28.838002 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 136/267] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:28 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:29.247301 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-a4a75e88-270d-43e9-8648-8169a001b193 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:29.247994 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-a4a75e88-270d-43e9-8648-8169a001b193 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:29.268656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a4a75e88-270d-43e9-8648-8169a001b193 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:29.269247 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a4a75e88-270d-43e9-8648-8169a001b193 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:29.269749 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a4a75e88-270d-43e9-8648-8169a001b193 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:29.270449 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a4a75e88-270d-43e9-8648-8169a001b193 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:29.270975 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a4a75e88-270d-43e9-8648-8169a001b193 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:29.271440 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a4a75e88-270d-43e9-8648-8169a001b193 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:29.426914 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-a4a75e88-270d-43e9-8648-8169a001b193 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:29.437085 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-a4a75e88-270d-43e9-8648-8169a001b193 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1722 microversion: 2.1 time: 0.194137 Sep 19 12:28:29.437852 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 132/268] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:29 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:29.860664 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-7bc68d19-53d1-4bdb-948e-60b0b391719e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:29.861267 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-7bc68d19-53d1-4bdb-948e-60b0b391719e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:29.867874 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7bc68d19-53d1-4bdb-948e-60b0b391719e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:29.869881 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7bc68d19-53d1-4bdb-948e-60b0b391719e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:29.869881 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7bc68d19-53d1-4bdb-948e-60b0b391719e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:29.869881 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7bc68d19-53d1-4bdb-948e-60b0b391719e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:29.870180 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7bc68d19-53d1-4bdb-948e-60b0b391719e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:29.870406 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7bc68d19-53d1-4bdb-948e-60b0b391719e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:30.018790 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-7bc68d19-53d1-4bdb-948e-60b0b391719e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:30.028514 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-7bc68d19-53d1-4bdb-948e-60b0b391719e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.171659 Sep 19 12:28:30.029434 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 137/269] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:29 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:30.479393 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5e8213b3-e4c4-462a-b3fe-cb6dafcb4fef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:30.480041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-5e8213b3-e4c4-462a-b3fe-cb6dafcb4fef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:30.487431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5e8213b3-e4c4-462a-b3fe-cb6dafcb4fef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:30.487913 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5e8213b3-e4c4-462a-b3fe-cb6dafcb4fef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:30.488393 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5e8213b3-e4c4-462a-b3fe-cb6dafcb4fef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:30.489113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5e8213b3-e4c4-462a-b3fe-cb6dafcb4fef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:30.489556 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5e8213b3-e4c4-462a-b3fe-cb6dafcb4fef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:30.489972 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5e8213b3-e4c4-462a-b3fe-cb6dafcb4fef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:30.809635 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-5e8213b3-e4c4-462a-b3fe-cb6dafcb4fef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:30.820009 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5e8213b3-e4c4-462a-b3fe-cb6dafcb4fef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1722 microversion: 2.1 time: 0.344491 Sep 19 12:28:30.820909 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 133/270] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:30 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1722 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:31.051829 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-13a9f67b-79c9-420d-b4ba-7585fac410cd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:31.052468 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-13a9f67b-79c9-420d-b4ba-7585fac410cd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:31.059278 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-13a9f67b-79c9-420d-b4ba-7585fac410cd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:31.059760 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-13a9f67b-79c9-420d-b4ba-7585fac410cd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:31.060190 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-13a9f67b-79c9-420d-b4ba-7585fac410cd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:31.060906 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-13a9f67b-79c9-420d-b4ba-7585fac410cd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:31.061355 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-13a9f67b-79c9-420d-b4ba-7585fac410cd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:31.061778 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-13a9f67b-79c9-420d-b4ba-7585fac410cd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:31.281591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-13a9f67b-79c9-420d-b4ba-7585fac410cd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:31.291776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-13a9f67b-79c9-420d-b4ba-7585fac410cd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1500 microversion: 2.1 time: 0.244036 Sep 19 12:28:31.292572 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 138/271] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:31 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1500 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:31.315797 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-bdb70540-705f-4e27-a64c-c0493c1bbc80 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da45b448-cb3f-42d5-84b7-6c0c78190cae"}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:28:31.318608 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-bdb70540-705f-4e27-a64c-c0493c1bbc80 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:31.324885 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bdb70540-705f-4e27-a64c-c0493c1bbc80 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:31.325705 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bdb70540-705f-4e27-a64c-c0493c1bbc80 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:31.326365 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bdb70540-705f-4e27-a64c-c0493c1bbc80 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:31.327120 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bdb70540-705f-4e27-a64c-c0493c1bbc80 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:31.327572 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bdb70540-705f-4e27-a64c-c0493c1bbc80 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:31.328018 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bdb70540-705f-4e27-a64c-c0493c1bbc80 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:31.359316 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-bdb70540-705f-4e27-a64c-c0493c1bbc80 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] HTTP exception thrown: Cannot 'attach_volume' instance aa0ab2f3-883e-4b45-95d1-d0f8895fc401 while it is in vm_state rescued Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-bdb70540-705f-4e27-a64c-c0493c1bbc80 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Request method failure captured: Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: POST /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401/os-volume_attachments HTTP/1.1 Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 74 Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKF_tWWphb1JAPvN-EIEQSK52IRz3n-JW79g8MyFMBDW4gW63g8tf-8d7IlXyjaWL-wltQwHjjhVXyF95eo-sDcZPzinRtVOt-jy7eoPO5RoogsMqWYA2aauMqxMNdK7rALFC559OD52R_2prEh0aku1gmbjxDr3u7abPo2C0r5Yj86w Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: b4cb72be6f7d411fbfd037aebc273cb2 Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1257684246 Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:28:31.374073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:28:31.375366 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4cb72be6f7d411fbfd037aebc273cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b4cb72be6f7d411fbfd037aebc273cb2", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4cb72be6f7d411fbfd037aebc273cb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b4cb72be6f7d411fbfd037aebc273cb2"}]}] Sep 19 12:28:31.375366 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1257684246 Sep 19 12:28:31.375366 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: b4cb72be6f7d411fbfd037aebc273cb2 Sep 19 12:28:31.375366 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1257684246 Sep 19 12:28:31.375366 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-ServerRescueNegativeTestJSON-1257684246-project Sep 19 12:28:31.375366 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:28:31.375366 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:28:31.375366 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 90ec87808ac641329bc1491d1b5473d9 Sep 19 12:28:31.375366 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1257684246-project Sep 19 12:28:31.375366 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Sep 19 12:28:31.375366 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {"volumeAttachment": {"volumeId": "da45b448-cb3f-42d5-84b7-6c0c78190cae"}} Sep 19 12:28:31.375366 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:28:31.376294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Cannot 'attach_volume' instance aa0ab2f3-883e-4b45-95d1-d0f8895fc401 while it is in vm_state rescued Sep 19 12:28:31.376294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'server_id': 'aa0ab2f3-883e-4b45-95d1-d0f8895fc401', 'body': {'volumeAttachment': {'volumeId': 'da45b448-cb3f-42d5-84b7-6c0c78190cae'}}} Sep 19 12:28:31.376294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:28:31.376294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:28:31.376294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 12:28:31.376294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 12:28:31.376294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 12:28:31.376294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 12:28:31.376294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 12:28:31.376294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 12:28:31.376294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aa0ab2f3-883e-4b45-95d1-d0f8895fc401 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 19 12:28:31.376294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:28:31.376294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:28:31.376294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:28:31.376294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:28:31.376294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:28:31.376294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:28:31.376294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:28:31.376294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:28:31.377439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:28:31.377439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:28:31.377439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:28:31.377439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:28:31.377439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:28:31.377439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:28:31.377439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:28:31.377439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:28:31.377439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 19 12:28:31.377439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 12:28:31.377439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 12:28:31.377439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 12:28:31.377439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance aa0ab2f3-883e-4b45-95d1-d0f8895fc401 while it is in vm_state rescued Sep 19 12:28:31.377439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:28:31.377439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:28:31.377439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:28:31.377439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:28:31.377439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:28:31.377439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:28:31.379539 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:28:31.379539 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:28:31.379539 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance aa0ab2f3-883e-4b45-95d1-d0f8895fc401 while it is in vm_state rescued Sep 19 12:28:31.379539 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:28:31.379539 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-bdb70540-705f-4e27-a64c-c0493c1bbc80 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Returning 409 to user: Cannot 'attach_volume' instance aa0ab2f3-883e-4b45-95d1-d0f8895fc401 while it is in vm_state rescued {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:28:31.379539 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-bdb70540-705f-4e27-a64c-c0493c1bbc80 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "POST /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.064426 Sep 19 12:28:31.381233 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 134/272] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Sep 19 12:28:31 2022] POST /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401/os-volume_attachments => generated 152 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 12:28:31.386031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-faf6de68-de08-4613-85ed-3d7720ea4670 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:28:31.386602 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-faf6de68-de08-4613-85ed-3d7720ea4670 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:31.397539 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-faf6de68-de08-4613-85ed-3d7720ea4670 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:31.400093 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-faf6de68-de08-4613-85ed-3d7720ea4670 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:31.400572 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-faf6de68-de08-4613-85ed-3d7720ea4670 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:31.401479 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-faf6de68-de08-4613-85ed-3d7720ea4670 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:31.402592 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-faf6de68-de08-4613-85ed-3d7720ea4670 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:31.404797 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-faf6de68-de08-4613-85ed-3d7720ea4670 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:31.436908 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:31.755588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-faf6de68-de08-4613-85ed-3d7720ea4670 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "POST /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401/action" status: 202 len: 0 microversion: 2.1 time: 0.373750 Sep 19 12:28:31.759333 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 139/273] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Sep 19 12:28:31 2022] POST /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 12:28:31.764962 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4ad56afa-1aba-49ba-820a-c5379e994524 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:31.765634 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4ad56afa-1aba-49ba-820a-c5379e994524 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:31.773284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4ad56afa-1aba-49ba-820a-c5379e994524 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:31.773826 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4ad56afa-1aba-49ba-820a-c5379e994524 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:31.774267 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4ad56afa-1aba-49ba-820a-c5379e994524 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:31.774961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4ad56afa-1aba-49ba-820a-c5379e994524 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:31.775418 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4ad56afa-1aba-49ba-820a-c5379e994524 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:31.775850 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4ad56afa-1aba-49ba-820a-c5379e994524 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:31.845564 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-14ea3e57-c752-4c90-abcb-ba6bed86a9b1 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:31.846261 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-14ea3e57-c752-4c90-abcb-ba6bed86a9b1 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:31.853265 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-14ea3e57-c752-4c90-abcb-ba6bed86a9b1 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:31.853749 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-14ea3e57-c752-4c90-abcb-ba6bed86a9b1 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:31.854178 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-14ea3e57-c752-4c90-abcb-ba6bed86a9b1 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:31.854866 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-14ea3e57-c752-4c90-abcb-ba6bed86a9b1 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:31.855308 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-14ea3e57-c752-4c90-abcb-ba6bed86a9b1 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:31.855727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-14ea3e57-c752-4c90-abcb-ba6bed86a9b1 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:31.951854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-4ad56afa-1aba-49ba-820a-c5379e994524 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:31.961393 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4ad56afa-1aba-49ba-820a-c5379e994524 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1508 microversion: 2.1 time: 0.200485 Sep 19 12:28:31.961975 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 135/274] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:31 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:32.061453 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-14ea3e57-c752-4c90-abcb-ba6bed86a9b1 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:32.069872 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-14ea3e57-c752-4c90-abcb-ba6bed86a9b1 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1722 microversion: 2.1 time: 0.228829 Sep 19 12:28:32.070449 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 140/275] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:31 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:32.987030 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-1a1e087f-7f31-4f85-b1a9-7d7cdb3b0ea0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:32.987632 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-1a1e087f-7f31-4f85-b1a9-7d7cdb3b0ea0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:32.994510 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1a1e087f-7f31-4f85-b1a9-7d7cdb3b0ea0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:32.994990 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1a1e087f-7f31-4f85-b1a9-7d7cdb3b0ea0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:32.995515 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1a1e087f-7f31-4f85-b1a9-7d7cdb3b0ea0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:32.996209 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1a1e087f-7f31-4f85-b1a9-7d7cdb3b0ea0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:32.996675 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1a1e087f-7f31-4f85-b1a9-7d7cdb3b0ea0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:32.997096 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1a1e087f-7f31-4f85-b1a9-7d7cdb3b0ea0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:33.092962 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-5ce5af81-dcff-4794-b575-555f16a2b301 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:33.093572 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-5ce5af81-dcff-4794-b575-555f16a2b301 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:33.100638 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5ce5af81-dcff-4794-b575-555f16a2b301 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:33.101125 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5ce5af81-dcff-4794-b575-555f16a2b301 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:33.101557 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5ce5af81-dcff-4794-b575-555f16a2b301 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:33.102248 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5ce5af81-dcff-4794-b575-555f16a2b301 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:33.102697 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5ce5af81-dcff-4794-b575-555f16a2b301 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:33.103124 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5ce5af81-dcff-4794-b575-555f16a2b301 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:33.124305 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-1a1e087f-7f31-4f85-b1a9-7d7cdb3b0ea0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:33.132794 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-1a1e087f-7f31-4f85-b1a9-7d7cdb3b0ea0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1508 microversion: 2.1 time: 0.149051 Sep 19 12:28:33.133590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 136/276] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:32 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:33.229846 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5ce5af81-dcff-4794-b575-555f16a2b301 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:33.238639 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-5ce5af81-dcff-4794-b575-555f16a2b301 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1722 microversion: 2.1 time: 0.149323 Sep 19 12:28:33.239057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 141/277] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:33 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:28:34.156080 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-69b2c5bf-b162-48ac-b891-77b1e4a89a7d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:34.156750 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-69b2c5bf-b162-48ac-b891-77b1e4a89a7d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:34.163874 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-69b2c5bf-b162-48ac-b891-77b1e4a89a7d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:34.164364 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-69b2c5bf-b162-48ac-b891-77b1e4a89a7d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:34.164832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-69b2c5bf-b162-48ac-b891-77b1e4a89a7d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:34.165536 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-69b2c5bf-b162-48ac-b891-77b1e4a89a7d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:34.166145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-69b2c5bf-b162-48ac-b891-77b1e4a89a7d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:34.166724 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-69b2c5bf-b162-48ac-b891-77b1e4a89a7d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:34.263139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-35b8cb49-b871-4160-affd-0de818ca22e5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:34.264768 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-35b8cb49-b871-4160-affd-0de818ca22e5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:34.273161 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-35b8cb49-b871-4160-affd-0de818ca22e5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:34.273888 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-35b8cb49-b871-4160-affd-0de818ca22e5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:34.275120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-35b8cb49-b871-4160-affd-0de818ca22e5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:34.276144 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-35b8cb49-b871-4160-affd-0de818ca22e5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:34.276591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-35b8cb49-b871-4160-affd-0de818ca22e5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:34.277114 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-35b8cb49-b871-4160-affd-0de818ca22e5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:34.309581 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-69b2c5bf-b162-48ac-b891-77b1e4a89a7d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:34.317669 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-69b2c5bf-b162-48ac-b891-77b1e4a89a7d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1508 microversion: 2.1 time: 0.165467 Sep 19 12:28:34.320356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 137/278] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:34 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:34.405783 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-35b8cb49-b871-4160-affd-0de818ca22e5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:34.414760 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-35b8cb49-b871-4160-affd-0de818ca22e5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1722 microversion: 2.1 time: 0.156011 Sep 19 12:28:34.415339 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 142/279] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:34 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:35.340528 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b9691a42-aa1e-460d-8623-d643554ca794 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:35.341164 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b9691a42-aa1e-460d-8623-d643554ca794 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:35.347588 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b9691a42-aa1e-460d-8623-d643554ca794 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:35.348068 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b9691a42-aa1e-460d-8623-d643554ca794 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:35.348505 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b9691a42-aa1e-460d-8623-d643554ca794 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:35.349214 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b9691a42-aa1e-460d-8623-d643554ca794 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:35.349663 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b9691a42-aa1e-460d-8623-d643554ca794 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:35.350102 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b9691a42-aa1e-460d-8623-d643554ca794 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:35.437918 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-6c353b38-89e0-430f-931e-a9be1b8d1df0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:35.438531 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6c353b38-89e0-430f-931e-a9be1b8d1df0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:35.445542 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6c353b38-89e0-430f-931e-a9be1b8d1df0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:35.446022 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6c353b38-89e0-430f-931e-a9be1b8d1df0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:35.446445 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6c353b38-89e0-430f-931e-a9be1b8d1df0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:35.447135 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6c353b38-89e0-430f-931e-a9be1b8d1df0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:35.447578 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6c353b38-89e0-430f-931e-a9be1b8d1df0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:35.447990 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6c353b38-89e0-430f-931e-a9be1b8d1df0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:35.823437 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-b9691a42-aa1e-460d-8623-d643554ca794 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:35.831893 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-b9691a42-aa1e-460d-8623-d643554ca794 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1508 microversion: 2.1 time: 0.495011 Sep 19 12:28:35.832478 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 138/280] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:35 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1508 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:35.846957 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-6c353b38-89e0-430f-931e-a9be1b8d1df0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:35.855801 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-6c353b38-89e0-430f-931e-a9be1b8d1df0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1722 microversion: 2.1 time: 0.421643 Sep 19 12:28:35.856262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 143/281] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:35 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1722 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:28:36.857479 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-65632fff-f568-4ea3-a9a5-b0f9b3cb76de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:36.858099 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-65632fff-f568-4ea3-a9a5-b0f9b3cb76de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:36.864781 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-65632fff-f568-4ea3-a9a5-b0f9b3cb76de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:36.865263 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-65632fff-f568-4ea3-a9a5-b0f9b3cb76de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:36.865707 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-65632fff-f568-4ea3-a9a5-b0f9b3cb76de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:36.866999 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-65632fff-f568-4ea3-a9a5-b0f9b3cb76de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:36.867466 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-65632fff-f568-4ea3-a9a5-b0f9b3cb76de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:36.867905 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-65632fff-f568-4ea3-a9a5-b0f9b3cb76de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:36.879678 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ddc8b60a-6c78-473f-be3e-952abc6abdfa tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:36.880323 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-ddc8b60a-6c78-473f-be3e-952abc6abdfa tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:36.887017 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ddc8b60a-6c78-473f-be3e-952abc6abdfa tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:36.887518 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ddc8b60a-6c78-473f-be3e-952abc6abdfa tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:36.887960 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ddc8b60a-6c78-473f-be3e-952abc6abdfa tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:36.889182 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ddc8b60a-6c78-473f-be3e-952abc6abdfa tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:36.894736 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ddc8b60a-6c78-473f-be3e-952abc6abdfa tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:36.894736 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ddc8b60a-6c78-473f-be3e-952abc6abdfa tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:37.103442 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-ddc8b60a-6c78-473f-be3e-952abc6abdfa tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:37.109137 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-65632fff-f568-4ea3-a9a5-b0f9b3cb76de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:37.113779 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ddc8b60a-6c78-473f-be3e-952abc6abdfa tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1722 microversion: 2.1 time: 0.238055 Sep 19 12:28:37.114608 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 144/282] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:36 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:28:37.119071 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-65632fff-f568-4ea3-a9a5-b0f9b3cb76de tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1508 microversion: 2.1 time: 0.265439 Sep 19 12:28:37.119655 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 139/283] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:36 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1508 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:38.143102 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f14ef42b-c98b-4fc9-ac60-58e19fa79e0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:38.143607 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-13db27e1-4a3d-4b90-a1e0-23a392e06907 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:38.144090 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f14ef42b-c98b-4fc9-ac60-58e19fa79e0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:38.144198 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-13db27e1-4a3d-4b90-a1e0-23a392e06907 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:38.151442 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-13db27e1-4a3d-4b90-a1e0-23a392e06907 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:38.151943 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-13db27e1-4a3d-4b90-a1e0-23a392e06907 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:38.152378 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-13db27e1-4a3d-4b90-a1e0-23a392e06907 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:38.153099 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-13db27e1-4a3d-4b90-a1e0-23a392e06907 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:38.153544 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-13db27e1-4a3d-4b90-a1e0-23a392e06907 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:38.154002 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-13db27e1-4a3d-4b90-a1e0-23a392e06907 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:38.156159 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f14ef42b-c98b-4fc9-ac60-58e19fa79e0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:38.156674 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f14ef42b-c98b-4fc9-ac60-58e19fa79e0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:38.157114 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f14ef42b-c98b-4fc9-ac60-58e19fa79e0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:38.157878 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f14ef42b-c98b-4fc9-ac60-58e19fa79e0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:38.158341 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f14ef42b-c98b-4fc9-ac60-58e19fa79e0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:38.158765 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f14ef42b-c98b-4fc9-ac60-58e19fa79e0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:38.347018 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-13db27e1-4a3d-4b90-a1e0-23a392e06907 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:38.350908 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f14ef42b-c98b-4fc9-ac60-58e19fa79e0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:38.355961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-13db27e1-4a3d-4b90-a1e0-23a392e06907 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1722 microversion: 2.1 time: 0.216312 Sep 19 12:28:38.356762 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 140/284] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:38 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:28:38.358754 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f14ef42b-c98b-4fc9-ac60-58e19fa79e0c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1508 microversion: 2.1 time: 0.219751 Sep 19 12:28:38.359308 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 145/285] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:38 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1508 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:39.380391 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-63921378-cfac-4d79-9da9-f4fc8ddbbfb8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:39.382472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-63921378-cfac-4d79-9da9-f4fc8ddbbfb8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:39.383052 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c9aa4e2a-5865-4c86-a8d5-16392b4bf71c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:39.383656 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c9aa4e2a-5865-4c86-a8d5-16392b4bf71c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:39.389767 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-63921378-cfac-4d79-9da9-f4fc8ddbbfb8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:39.390261 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-63921378-cfac-4d79-9da9-f4fc8ddbbfb8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:39.390752 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-63921378-cfac-4d79-9da9-f4fc8ddbbfb8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:39.391562 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-63921378-cfac-4d79-9da9-f4fc8ddbbfb8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:39.391944 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c9aa4e2a-5865-4c86-a8d5-16392b4bf71c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:39.392056 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-63921378-cfac-4d79-9da9-f4fc8ddbbfb8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:39.392437 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c9aa4e2a-5865-4c86-a8d5-16392b4bf71c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:39.392572 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-63921378-cfac-4d79-9da9-f4fc8ddbbfb8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:39.392892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c9aa4e2a-5865-4c86-a8d5-16392b4bf71c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:39.393595 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c9aa4e2a-5865-4c86-a8d5-16392b4bf71c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:39.394036 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c9aa4e2a-5865-4c86-a8d5-16392b4bf71c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:39.394451 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c9aa4e2a-5865-4c86-a8d5-16392b4bf71c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:39.593497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-63921378-cfac-4d79-9da9-f4fc8ddbbfb8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:39.598637 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:39.598935 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c9aa4e2a-5865-4c86-a8d5-16392b4bf71c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:39.604985 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-63921378-cfac-4d79-9da9-f4fc8ddbbfb8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1722 microversion: 2.1 time: 0.228654 Sep 19 12:28:39.605741 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 141/286] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:39 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:39.610773 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c9aa4e2a-5865-4c86-a8d5-16392b4bf71c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1508 microversion: 2.1 time: 0.232310 Sep 19 12:28:39.611593 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 146/287] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:39 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:28:40.565404 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-183346e3-a834-45a4-b8cb-957e633ee4e4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:40.565944 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-183346e3-a834-45a4-b8cb-957e633ee4e4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:40.573398 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-183346e3-a834-45a4-b8cb-957e633ee4e4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:40.573900 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-183346e3-a834-45a4-b8cb-957e633ee4e4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:40.574333 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-183346e3-a834-45a4-b8cb-957e633ee4e4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:40.575028 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-183346e3-a834-45a4-b8cb-957e633ee4e4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:40.575494 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-183346e3-a834-45a4-b8cb-957e633ee4e4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:40.575888 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-183346e3-a834-45a4-b8cb-957e633ee4e4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:40.601002 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-183346e3-a834-45a4-b8cb-957e633ee4e4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068/ips" status: 200 len: 150 microversion: 2.1 time: 0.039547 Sep 19 12:28:40.608943 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 142/288] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Sep 19 12:28:40 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:28:40.630079 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-05091ab8-7af7-46a4-9781-23c4d7a39c97 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:40.631547 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-05091ab8-7af7-46a4-9781-23c4d7a39c97 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:40.636370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-7887b5c9-90f3-4eba-8406-c10a563a33e7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:40.638013 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-7887b5c9-90f3-4eba-8406-c10a563a33e7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:40.645165 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7887b5c9-90f3-4eba-8406-c10a563a33e7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:40.645665 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-05091ab8-7af7-46a4-9781-23c4d7a39c97 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:40.645993 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7887b5c9-90f3-4eba-8406-c10a563a33e7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:40.646449 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-05091ab8-7af7-46a4-9781-23c4d7a39c97 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:40.646784 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7887b5c9-90f3-4eba-8406-c10a563a33e7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:40.648293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-05091ab8-7af7-46a4-9781-23c4d7a39c97 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:40.648652 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7887b5c9-90f3-4eba-8406-c10a563a33e7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:40.649757 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7887b5c9-90f3-4eba-8406-c10a563a33e7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:40.650333 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7887b5c9-90f3-4eba-8406-c10a563a33e7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:40.650450 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-05091ab8-7af7-46a4-9781-23c4d7a39c97 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:40.651619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-05091ab8-7af7-46a4-9781-23c4d7a39c97 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:40.653796 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-05091ab8-7af7-46a4-9781-23c4d7a39c97 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:40.899983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-05091ab8-7af7-46a4-9781-23c4d7a39c97 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:40.906768 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-7887b5c9-90f3-4eba-8406-c10a563a33e7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:40.912349 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-05091ab8-7af7-46a4-9781-23c4d7a39c97 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1722 microversion: 2.1 time: 0.286052 Sep 19 12:28:40.917445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-7887b5c9-90f3-4eba-8406-c10a563a33e7 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1508 microversion: 2.1 time: 0.284969 Sep 19 12:28:40.918979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 143/289] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:40 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1508 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:28:40.925098 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 147/290] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:40 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:41.943320 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9fced09e-7917-449b-9263-b2c67885b4b5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:41.943927 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9fced09e-7917-449b-9263-b2c67885b4b5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:41.946261 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-17295f82-3c1a-4c9d-9559-03b79a5d9783 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:41.946728 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=42 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:41.947580 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-17295f82-3c1a-4c9d-9559-03b79a5d9783 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:41.951300 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9fced09e-7917-449b-9263-b2c67885b4b5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:41.951875 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9fced09e-7917-449b-9263-b2c67885b4b5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:41.952307 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9fced09e-7917-449b-9263-b2c67885b4b5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:41.953027 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9fced09e-7917-449b-9263-b2c67885b4b5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:41.953474 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9fced09e-7917-449b-9263-b2c67885b4b5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:41.953890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9fced09e-7917-449b-9263-b2c67885b4b5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:41.954014 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-17295f82-3c1a-4c9d-9559-03b79a5d9783 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:41.954492 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-17295f82-3c1a-4c9d-9559-03b79a5d9783 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:41.954926 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-17295f82-3c1a-4c9d-9559-03b79a5d9783 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:41.955607 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-17295f82-3c1a-4c9d-9559-03b79a5d9783 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:41.956058 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-17295f82-3c1a-4c9d-9559-03b79a5d9783 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:41.956484 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-17295f82-3c1a-4c9d-9559-03b79a5d9783 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:42.157055 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9fced09e-7917-449b-9263-b2c67885b4b5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:42.161363 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-17295f82-3c1a-4c9d-9559-03b79a5d9783 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:42.166231 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9fced09e-7917-449b-9263-b2c67885b4b5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1722 microversion: 2.1 time: 0.226740 Sep 19 12:28:42.166803 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 144/291] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:41 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:42.170441 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-17295f82-3c1a-4c9d-9559-03b79a5d9783 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1514 microversion: 2.1 time: 0.227840 Sep 19 12:28:42.173516 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 148/292] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:41 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:28:42.626076 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c304a09d-3a2a-41ab-a4c8-13963331bcde tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36194571-1d0e-4b41-a304-cb1f03f5b37b"}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:28:42.628491 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c304a09d-3a2a-41ab-a4c8-13963331bcde tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:42.634649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c304a09d-3a2a-41ab-a4c8-13963331bcde tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:42.635135 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c304a09d-3a2a-41ab-a4c8-13963331bcde tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:42.635565 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c304a09d-3a2a-41ab-a4c8-13963331bcde tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:42.636250 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c304a09d-3a2a-41ab-a4c8-13963331bcde tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:42.636756 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c304a09d-3a2a-41ab-a4c8-13963331bcde tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:42.637177 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c304a09d-3a2a-41ab-a4c8-13963331bcde tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:43.191226 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-4de1eca2-24be-48db-8282-c32dc6d44a08 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:43.191826 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-4de1eca2-24be-48db-8282-c32dc6d44a08 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:43.199654 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4de1eca2-24be-48db-8282-c32dc6d44a08 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:43.200135 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4de1eca2-24be-48db-8282-c32dc6d44a08 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:43.200576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4de1eca2-24be-48db-8282-c32dc6d44a08 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:43.201302 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4de1eca2-24be-48db-8282-c32dc6d44a08 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:43.201753 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4de1eca2-24be-48db-8282-c32dc6d44a08 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:43.202176 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4de1eca2-24be-48db-8282-c32dc6d44a08 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:43.346374 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-4de1eca2-24be-48db-8282-c32dc6d44a08 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:43.355407 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-4de1eca2-24be-48db-8282-c32dc6d44a08 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1722 microversion: 2.1 time: 0.169058 Sep 19 12:28:43.355970 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 149/293] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:43 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:28:43.607463 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c304a09d-3a2a-41ab-a4c8-13963331bcde tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "POST /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.985924 Sep 19 12:28:43.611041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 145/294] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Sep 19 12:28:42 2022] POST /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068/os-volume_attachments => generated 194 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:28:43.968111 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b88c4e92-14f7-4c18-ba56-7ba4edab1c25 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Action: 'create', calling method: .version_select at 0x7f54b3707ee0>, body: {"keypair": {"name": "tempest-keypair-16208924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaiO4VY5BzJxUU4pNALkQbasfKBeIut5VwaWtgs1zxqjeC7V0m0AKcBOE9lQFpB3/hH4JAtouPM+HhobZ7yIsq2KXXZxfVZqkiBTtNZyCZnfjn2r6TG4e7ocAgsPtGo1g=="}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:28:43.984955 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-b88c4e92-14f7-4c18-ba56-7ba4edab1c25 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Getting quotas for project b4cb72be6f7d411fbfd037aebc273cb2. Resources: {'key_pairs'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:28:43.988988 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-b88c4e92-14f7-4c18-ba56-7ba4edab1c25 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Getting quotas for user 90ec87808ac641329bc1491d1b5473d9 and project b4cb72be6f7d411fbfd037aebc273cb2. Resources: {'key_pairs'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:28:44.079549 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-b88c4e92-14f7-4c18-ba56-7ba4edab1c25 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.115431 Sep 19 12:28:44.080584 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 150/295] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Sep 19 12:28:43 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:28:44.381430 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-f67057d5-3980-4a07-8a1d-e3c116156d83 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:44.382788 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-f67057d5-3980-4a07-8a1d-e3c116156d83 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:44.389571 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f67057d5-3980-4a07-8a1d-e3c116156d83 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:44.390052 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f67057d5-3980-4a07-8a1d-e3c116156d83 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:44.390489 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f67057d5-3980-4a07-8a1d-e3c116156d83 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:44.391215 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f67057d5-3980-4a07-8a1d-e3c116156d83 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:44.391665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f67057d5-3980-4a07-8a1d-e3c116156d83 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:44.392081 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f67057d5-3980-4a07-8a1d-e3c116156d83 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:44.535841 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-f67057d5-3980-4a07-8a1d-e3c116156d83 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:44.545525 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-f67057d5-3980-4a07-8a1d-e3c116156d83 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1699 microversion: 2.1 time: 0.168875 Sep 19 12:28:44.546108 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 146/296] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:44 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1699 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:44.570263 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-0ee60d6f-4e71-46e9-80ae-9bef4adabb5a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:28:44.576976 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0ee60d6f-4e71-46e9-80ae-9bef4adabb5a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:44.577462 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0ee60d6f-4e71-46e9-80ae-9bef4adabb5a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:44.577950 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0ee60d6f-4e71-46e9-80ae-9bef4adabb5a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:44.601769 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-0ee60d6f-4e71-46e9-80ae-9bef4adabb5a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Going to try to start instance {{(pid=121428) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 12:28:44.842391 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-0ee60d6f-4e71-46e9-80ae-9bef4adabb5a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "POST /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/action" status: 202 len: 0 microversion: 2.1 time: 0.277022 Sep 19 12:28:44.843440 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 151/297] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Sep 19 12:28:44 2022] POST /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:28:44.858840 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-db4b5188-74e6-45cb-b04d-14100a56cfef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:44.859662 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-db4b5188-74e6-45cb-b04d-14100a56cfef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:44.876161 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-db4b5188-74e6-45cb-b04d-14100a56cfef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:44.876710 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-db4b5188-74e6-45cb-b04d-14100a56cfef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:44.877146 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-db4b5188-74e6-45cb-b04d-14100a56cfef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:44.877850 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-db4b5188-74e6-45cb-b04d-14100a56cfef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:44.878302 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-db4b5188-74e6-45cb-b04d-14100a56cfef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:44.878729 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-db4b5188-74e6-45cb-b04d-14100a56cfef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:45.027736 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-db4b5188-74e6-45cb-b04d-14100a56cfef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:45.035031 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-db4b5188-74e6-45cb-b04d-14100a56cfef tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1708 microversion: 2.1 time: 0.180077 Sep 19 12:28:45.036022 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 147/298] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:44 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1708 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:46.061132 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e37ca0c8-0c23-4ce6-97ae-5201b31c5a29 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:46.061730 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e37ca0c8-0c23-4ce6-97ae-5201b31c5a29 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:46.068259 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e37ca0c8-0c23-4ce6-97ae-5201b31c5a29 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:46.068773 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e37ca0c8-0c23-4ce6-97ae-5201b31c5a29 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:46.069205 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e37ca0c8-0c23-4ce6-97ae-5201b31c5a29 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:46.070093 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e37ca0c8-0c23-4ce6-97ae-5201b31c5a29 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:46.070546 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e37ca0c8-0c23-4ce6-97ae-5201b31c5a29 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:46.070971 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e37ca0c8-0c23-4ce6-97ae-5201b31c5a29 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:46.255819 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e37ca0c8-0c23-4ce6-97ae-5201b31c5a29 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:46.273936 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e37ca0c8-0c23-4ce6-97ae-5201b31c5a29 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1708 microversion: 2.1 time: 0.216676 Sep 19 12:28:46.276763 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 152/299] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:46 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1708 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:28:47.263392 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4292b1ce-8755-4922-970a-1e946a991d26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-137258568", "imageRef": "d4301833-8e96-46bf-a940-692f93f7fdba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cfe95f3e-3dda-428e-b0b1-ae445a370fb3"}], "security_groups": [{"name": "tempest-securitygroup--123615961"}], "key_name": "tempest-keypair-16208924", "user_data": "}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:28:47.299180 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-4252594e-361b-4df5-8f3c-094503c73b37 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:47.299784 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-4252594e-361b-4df5-8f3c-094503c73b37 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:47.307076 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4252594e-361b-4df5-8f3c-094503c73b37 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:47.307716 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4252594e-361b-4df5-8f3c-094503c73b37 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:47.308283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4252594e-361b-4df5-8f3c-094503c73b37 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:47.309980 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4252594e-361b-4df5-8f3c-094503c73b37 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:47.310458 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4252594e-361b-4df5-8f3c-094503c73b37 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:47.311178 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4252594e-361b-4df5-8f3c-094503c73b37 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:47.421860 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.network.neutron [None req-4292b1ce-8755-4922-970a-1e946a991d26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] validate_networks() for [('cfe95f3e-3dda-428e-b0b1-ae445a370fb3', None, None, None, None, None)] {{(pid=121429) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:28:47.528439 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-4252594e-361b-4df5-8f3c-094503c73b37 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:47.543056 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-4252594e-361b-4df5-8f3c-094503c73b37 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1712 microversion: 2.1 time: 0.247480 Sep 19 12:28:47.543641 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 153/300] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:47 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1712 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:28:47.857733 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-4292b1ce-8755-4922-970a-1e946a991d26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Flavor limits 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:28:47.858155 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-4292b1ce-8755-4922-970a-1e946a991d26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Image limits 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:28:47.858626 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-4292b1ce-8755-4922-970a-1e946a991d26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Flavor pref 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:28:47.860069 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-4292b1ce-8755-4922-970a-1e946a991d26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Image pref 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:28:47.860069 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-4292b1ce-8755-4922-970a-1e946a991d26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:28:47.869081 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4292b1ce-8755-4922-970a-1e946a991d26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:47.869558 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4292b1ce-8755-4922-970a-1e946a991d26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:47.870171 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4292b1ce-8755-4922-970a-1e946a991d26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:47.870903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4292b1ce-8755-4922-970a-1e946a991d26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:47.871358 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4292b1ce-8755-4922-970a-1e946a991d26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:47.871873 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4292b1ce-8755-4922-970a-1e946a991d26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:47.905412 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-4292b1ce-8755-4922-970a-1e946a991d26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Getting quotas for project b4cb72be6f7d411fbfd037aebc273cb2. Resources: {'instances', 'ram', 'cores'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:28:47.909573 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-4292b1ce-8755-4922-970a-1e946a991d26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Getting quotas for user 90ec87808ac641329bc1491d1b5473d9 and project b4cb72be6f7d411fbfd037aebc273cb2. Resources: {'instances', 'ram', 'cores'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:28:47.921777 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4292b1ce-8755-4922-970a-1e946a991d26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Going to run 1 instances... {{(pid=121429) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:28:47.924212 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4292b1ce-8755-4922-970a-1e946a991d26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4301833-8e96-46bf-a940-692f93f7fdba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121429) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:28:48.092406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4292b1ce-8755-4922-970a-1e946a991d26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.833509 Sep 19 12:28:48.093093 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 148/301] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:28:47 2022] POST /compute/v2.1/servers => generated 408 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:28:48.104560 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ed713a14-b5d1-493f-bd8a-c230835e6456 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:48.105288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-ed713a14-b5d1-493f-bd8a-c230835e6456 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:48.177438 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-ed713a14-b5d1-493f-bd8a-c230835e6456 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:48.185627 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ed713a14-b5d1-493f-bd8a-c230835e6456 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1243 microversion: 2.1 time: 0.084939 Sep 19 12:28:48.187871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 154/302] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:48 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1243 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:49.210597 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-7e5db0f6-eff2-4cfe-a86e-a729e527d4bf tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:49.211200 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-7e5db0f6-eff2-4cfe-a86e-a729e527d4bf tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:49.268448 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-7e5db0f6-eff2-4cfe-a86e-a729e527d4bf tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:49.276355 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-7e5db0f6-eff2-4cfe-a86e-a729e527d4bf tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1243 microversion: 2.1 time: 0.070487 Sep 19 12:28:49.276966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 149/303] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:49 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1243 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:50.300390 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-62fdbbbb-ff27-4f2f-b4e5-51ef7f2c870f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:50.303080 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-62fdbbbb-ff27-4f2f-b4e5-51ef7f2c870f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:50.310548 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-62fdbbbb-ff27-4f2f-b4e5-51ef7f2c870f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:50.311305 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-62fdbbbb-ff27-4f2f-b4e5-51ef7f2c870f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:50.312020 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-62fdbbbb-ff27-4f2f-b4e5-51ef7f2c870f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:50.313413 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-62fdbbbb-ff27-4f2f-b4e5-51ef7f2c870f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:50.313875 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-62fdbbbb-ff27-4f2f-b4e5-51ef7f2c870f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:50.314395 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-62fdbbbb-ff27-4f2f-b4e5-51ef7f2c870f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:50.395152 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-62fdbbbb-ff27-4f2f-b4e5-51ef7f2c870f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:50.402928 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-62fdbbbb-ff27-4f2f-b4e5-51ef7f2c870f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1239 microversion: 2.1 time: 0.107522 Sep 19 12:28:50.403489 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 155/304] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:50 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1239 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:51.425079 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c1c4155e-5706-4eca-b1ba-8a9aae56043b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:51.425727 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c1c4155e-5706-4eca-b1ba-8a9aae56043b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:51.434638 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1c4155e-5706-4eca-b1ba-8a9aae56043b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:51.434638 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1c4155e-5706-4eca-b1ba-8a9aae56043b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:51.434638 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1c4155e-5706-4eca-b1ba-8a9aae56043b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:51.434638 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1c4155e-5706-4eca-b1ba-8a9aae56043b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:51.435020 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1c4155e-5706-4eca-b1ba-8a9aae56043b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:51.435131 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1c4155e-5706-4eca-b1ba-8a9aae56043b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:51.513819 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c1c4155e-5706-4eca-b1ba-8a9aae56043b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:51.530248 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c1c4155e-5706-4eca-b1ba-8a9aae56043b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1295 microversion: 2.1 time: 0.108915 Sep 19 12:28:51.537456 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 150/305] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:51 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1295 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:52.383459 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8c7eff4a-d64e-4664-b873-3141e7fb5397 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Action: 'create', calling method: .version_select at 0x7f54b362e160>, body: {"keypair": {"name": "tempest-keypair-1199228932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmqGhxFbpOfOYzx4s+P0I8zqdkcmbhEI9LV4VJOjbyuyWNvHbjUbnxOf0I8slwk1I1TrKDWsFNHQawYOOnRSjK/vRXDZ/DtVUaSl+3PNPTZYImVaUyIYeTQEovOplCpDQ=="}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:28:52.400248 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-8c7eff4a-d64e-4664-b873-3141e7fb5397 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Getting quotas for project 68496d9aa29542139f00104051248a5b. Resources: {'key_pairs'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:28:52.405260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-8c7eff4a-d64e-4664-b873-3141e7fb5397 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Getting quotas for user 3a48e0ab477f43d294607d441af0b444 and project 68496d9aa29542139f00104051248a5b. Resources: {'key_pairs'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:28:52.516178 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8c7eff4a-d64e-4664-b873-3141e7fb5397 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.136551 Sep 19 12:28:52.516933 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 156/306] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Sep 19 12:28:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:28:52.554647 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ea6230ca-1488-42e7-bd4b-52d60a4e0491 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:52.555556 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ea6230ca-1488-42e7-bd4b-52d60a4e0491 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:52.561991 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ea6230ca-1488-42e7-bd4b-52d60a4e0491 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:52.562587 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ea6230ca-1488-42e7-bd4b-52d60a4e0491 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:52.563016 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ea6230ca-1488-42e7-bd4b-52d60a4e0491 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:52.563803 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ea6230ca-1488-42e7-bd4b-52d60a4e0491 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:52.564309 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ea6230ca-1488-42e7-bd4b-52d60a4e0491 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:52.564758 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ea6230ca-1488-42e7-bd4b-52d60a4e0491 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:52.627547 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ea6230ca-1488-42e7-bd4b-52d60a4e0491 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:52.635838 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ea6230ca-1488-42e7-bd4b-52d60a4e0491 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1301 microversion: 2.1 time: 0.085670 Sep 19 12:28:52.636414 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 151/307] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:52 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1301 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:53.659846 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-09fed856-9d51-426e-8bb1-cc8524d65ad2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:53.660449 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-09fed856-9d51-426e-8bb1-cc8524d65ad2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:53.667316 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-09fed856-9d51-426e-8bb1-cc8524d65ad2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:53.667803 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-09fed856-9d51-426e-8bb1-cc8524d65ad2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:53.668339 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-09fed856-9d51-426e-8bb1-cc8524d65ad2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:53.669005 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-09fed856-9d51-426e-8bb1-cc8524d65ad2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:53.669464 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-09fed856-9d51-426e-8bb1-cc8524d65ad2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:53.669887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-09fed856-9d51-426e-8bb1-cc8524d65ad2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:53.685188 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:53.844850 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-09fed856-9d51-426e-8bb1-cc8524d65ad2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:53.853630 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-09fed856-9d51-426e-8bb1-cc8524d65ad2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1368 microversion: 2.1 time: 0.198046 Sep 19 12:28:53.854778 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 157/308] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:53 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:53.856270 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-6ebd589d-2c04-4b89-96ad-319be76c74c4 req-851b1613-74fe-4d3b-ba64-702675b34076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5", "tag": "e85fffd8-bc70-45a1-bd7d-55d41cea22d2"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:28:53.872856 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-6ebd589d-2c04-4b89-96ad-319be76c74c4 req-851b1613-74fe-4d3b-ba64-702675b34076 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:53.873430 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-6ebd589d-2c04-4b89-96ad-319be76c74c4 req-851b1613-74fe-4d3b-ba64-702675b34076 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:53.873924 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-6ebd589d-2c04-4b89-96ad-319be76c74c4 req-851b1613-74fe-4d3b-ba64-702675b34076 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:53.886009 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-6ebd589d-2c04-4b89-96ad-319be76c74c4 req-851b1613-74fe-4d3b-ba64-702675b34076 service nova] Creating event network-changed:e85fffd8-bc70-45a1-bd7d-55d41cea22d2 for instance ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 on hv-cinder-85061 Sep 19 12:28:53.891920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-6ebd589d-2c04-4b89-96ad-319be76c74c4 req-851b1613-74fe-4d3b-ba64-702675b34076 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042070 Sep 19 12:28:53.895176 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 152/309] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:28:54.879613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-65625fca-630a-4137-bd57-a66c8555d71b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:54.880410 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-65625fca-630a-4137-bd57-a66c8555d71b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:54.889942 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65625fca-630a-4137-bd57-a66c8555d71b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:54.890528 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65625fca-630a-4137-bd57-a66c8555d71b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:54.891083 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65625fca-630a-4137-bd57-a66c8555d71b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:54.891862 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65625fca-630a-4137-bd57-a66c8555d71b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:54.892384 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65625fca-630a-4137-bd57-a66c8555d71b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:54.893749 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65625fca-630a-4137-bd57-a66c8555d71b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:55.027994 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-65625fca-630a-4137-bd57-a66c8555d71b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:55.036631 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-65625fca-630a-4137-bd57-a66c8555d71b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1368 microversion: 2.1 time: 0.161179 Sep 19 12:28:55.037630 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 158/310] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:54 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:56.028462 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c317f49c-e34d-4298-a958-82a15edf44c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-831292361", "imageRef": "d4301833-8e96-46bf-a940-692f93f7fdba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2775bc2c-1de6-4530-99c8-74593487735c"}], "security_groups": [{"name": "tempest-securitygroup--259458032"}], "key_name": "tempest-keypair-1199228932", "user_data": "}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:28:56.059754 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d13e7c60-4a09-487c-9d70-36394a86ef92 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:56.060356 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d13e7c60-4a09-487c-9d70-36394a86ef92 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:56.069741 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d13e7c60-4a09-487c-9d70-36394a86ef92 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:56.070239 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d13e7c60-4a09-487c-9d70-36394a86ef92 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:56.071173 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d13e7c60-4a09-487c-9d70-36394a86ef92 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:56.071945 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d13e7c60-4a09-487c-9d70-36394a86ef92 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:56.072403 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d13e7c60-4a09-487c-9d70-36394a86ef92 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:56.072971 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d13e7c60-4a09-487c-9d70-36394a86ef92 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:56.164890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.network.neutron [None req-c317f49c-e34d-4298-a958-82a15edf44c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] validate_networks() for [('2775bc2c-1de6-4530-99c8-74593487735c', None, None, None, None, None)] {{(pid=121429) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:28:56.296580 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-d13e7c60-4a09-487c-9d70-36394a86ef92 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:56.304159 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d13e7c60-4a09-487c-9d70-36394a86ef92 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1368 microversion: 2.1 time: 0.248496 Sep 19 12:28:56.304754 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 159/311] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:56 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:28:56.593292 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-c317f49c-e34d-4298-a958-82a15edf44c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Flavor limits 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:28:56.593708 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-c317f49c-e34d-4298-a958-82a15edf44c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Image limits 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:28:56.594294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-c317f49c-e34d-4298-a958-82a15edf44c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Flavor pref 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:28:56.594695 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-c317f49c-e34d-4298-a958-82a15edf44c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Image pref 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:28:56.595201 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-c317f49c-e34d-4298-a958-82a15edf44c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:28:56.604246 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c317f49c-e34d-4298-a958-82a15edf44c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:56.604749 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c317f49c-e34d-4298-a958-82a15edf44c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:56.605220 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c317f49c-e34d-4298-a958-82a15edf44c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:56.605937 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c317f49c-e34d-4298-a958-82a15edf44c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:56.606383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c317f49c-e34d-4298-a958-82a15edf44c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:56.606803 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c317f49c-e34d-4298-a958-82a15edf44c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:56.625539 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-c317f49c-e34d-4298-a958-82a15edf44c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Getting quotas for project 68496d9aa29542139f00104051248a5b. Resources: {'instances', 'ram', 'cores'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:28:56.629546 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-c317f49c-e34d-4298-a958-82a15edf44c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Getting quotas for user 3a48e0ab477f43d294607d441af0b444 and project 68496d9aa29542139f00104051248a5b. Resources: {'instances', 'ram', 'cores'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:28:56.640936 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c317f49c-e34d-4298-a958-82a15edf44c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Going to run 1 instances... {{(pid=121429) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:28:56.643431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c317f49c-e34d-4298-a958-82a15edf44c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4301833-8e96-46bf-a940-692f93f7fdba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121429) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:28:56.822806 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c317f49c-e34d-4298-a958-82a15edf44c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.799472 Sep 19 12:28:56.823800 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 153/312] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:28:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:28:56.834622 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-fe8a8a7f-8ebf-4d20-aea4-6e40794ba9fb tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:56.835154 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-fe8a8a7f-8ebf-4d20-aea4-6e40794ba9fb tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:56.891757 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-fe8a8a7f-8ebf-4d20-aea4-6e40794ba9fb tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:56.900363 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-fe8a8a7f-8ebf-4d20-aea4-6e40794ba9fb tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1241 microversion: 2.1 time: 0.069632 Sep 19 12:28:56.901229 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 160/313] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:56 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:57.328468 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e5e05c60-43c5-4ae7-8ef2-0441552c4d2a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:57.329281 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-e5e05c60-43c5-4ae7-8ef2-0441552c4d2a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:57.338459 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e5e05c60-43c5-4ae7-8ef2-0441552c4d2a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:57.338954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e5e05c60-43c5-4ae7-8ef2-0441552c4d2a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:57.339387 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e5e05c60-43c5-4ae7-8ef2-0441552c4d2a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:57.340071 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e5e05c60-43c5-4ae7-8ef2-0441552c4d2a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:57.340571 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e5e05c60-43c5-4ae7-8ef2-0441552c4d2a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:57.340965 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e5e05c60-43c5-4ae7-8ef2-0441552c4d2a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:57.484698 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e5e05c60-43c5-4ae7-8ef2-0441552c4d2a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:57.489685 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e5e05c60-43c5-4ae7-8ef2-0441552c4d2a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1368 microversion: 2.1 time: 0.165593 Sep 19 12:28:57.490250 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 154/314] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:57 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:57.922649 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-3160ee6e-2d02-4891-9c2f-1625a0e8c5fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:57.923496 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-3160ee6e-2d02-4891-9c2f-1625a0e8c5fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:57.930623 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3160ee6e-2d02-4891-9c2f-1625a0e8c5fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:57.931187 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3160ee6e-2d02-4891-9c2f-1625a0e8c5fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:57.931612 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3160ee6e-2d02-4891-9c2f-1625a0e8c5fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:57.936532 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3160ee6e-2d02-4891-9c2f-1625a0e8c5fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:57.936532 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3160ee6e-2d02-4891-9c2f-1625a0e8c5fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:57.936532 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3160ee6e-2d02-4891-9c2f-1625a0e8c5fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:57.996424 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-3160ee6e-2d02-4891-9c2f-1625a0e8c5fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:58.005639 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-3160ee6e-2d02-4891-9c2f-1625a0e8c5fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1245 microversion: 2.1 time: 0.086161 Sep 19 12:28:58.006249 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 161/315] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:57 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:58.513879 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-38522572-bd53-4cd7-8fe4-4452268b8f5b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:58.514516 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-38522572-bd53-4cd7-8fe4-4452268b8f5b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:58.521005 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-38522572-bd53-4cd7-8fe4-4452268b8f5b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:58.521536 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-38522572-bd53-4cd7-8fe4-4452268b8f5b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:58.523864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-38522572-bd53-4cd7-8fe4-4452268b8f5b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:58.523864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-38522572-bd53-4cd7-8fe4-4452268b8f5b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:58.523864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-38522572-bd53-4cd7-8fe4-4452268b8f5b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:58.523864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-38522572-bd53-4cd7-8fe4-4452268b8f5b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:58.665580 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-38522572-bd53-4cd7-8fe4-4452268b8f5b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:58.673201 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-38522572-bd53-4cd7-8fe4-4452268b8f5b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1368 microversion: 2.1 time: 0.163492 Sep 19 12:28:58.684888 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 155/316] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:58 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:59.043086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-640e6833-0e28-4dcc-a8b3-d6ffb37a9cc5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:59.043839 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-640e6833-0e28-4dcc-a8b3-d6ffb37a9cc5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:59.046134 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=2 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:59.051816 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-640e6833-0e28-4dcc-a8b3-d6ffb37a9cc5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:59.052298 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-640e6833-0e28-4dcc-a8b3-d6ffb37a9cc5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:59.052762 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-640e6833-0e28-4dcc-a8b3-d6ffb37a9cc5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:59.053452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-640e6833-0e28-4dcc-a8b3-d6ffb37a9cc5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:59.054713 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-640e6833-0e28-4dcc-a8b3-d6ffb37a9cc5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:59.054828 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-640e6833-0e28-4dcc-a8b3-d6ffb37a9cc5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:59.118523 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-640e6833-0e28-4dcc-a8b3-d6ffb37a9cc5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:59.126812 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-640e6833-0e28-4dcc-a8b3-d6ffb37a9cc5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1293 microversion: 2.1 time: 0.087623 Sep 19 12:28:59.130488 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 162/317] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:59 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:28:59.697650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5cd341b7-96ac-4bff-b2a6-ffd903b2aeee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:28:59.733112 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-5cd341b7-96ac-4bff-b2a6-ffd903b2aeee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:28:59.733112 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5cd341b7-96ac-4bff-b2a6-ffd903b2aeee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:59.733112 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5cd341b7-96ac-4bff-b2a6-ffd903b2aeee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:59.733112 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5cd341b7-96ac-4bff-b2a6-ffd903b2aeee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:59.734339 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5cd341b7-96ac-4bff-b2a6-ffd903b2aeee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:59.734339 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5cd341b7-96ac-4bff-b2a6-ffd903b2aeee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:59.734339 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5cd341b7-96ac-4bff-b2a6-ffd903b2aeee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:59.812115 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-8b576961-cdc0-4dfc-89b2-4fb59dbf0099 req-44aee85b-2ab4-4194-a0a9-3ddee5acb856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5", "name": "network-vif-plugged", "status": "completed", "tag": "e85fffd8-bc70-45a1-bd7d-55d41cea22d2"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:28:59.822362 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-8b576961-cdc0-4dfc-89b2-4fb59dbf0099 req-44aee85b-2ab4-4194-a0a9-3ddee5acb856 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:28:59.822887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-8b576961-cdc0-4dfc-89b2-4fb59dbf0099 req-44aee85b-2ab4-4194-a0a9-3ddee5acb856 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:28:59.823345 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-8b576961-cdc0-4dfc-89b2-4fb59dbf0099 req-44aee85b-2ab4-4194-a0a9-3ddee5acb856 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:28:59.834721 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-8b576961-cdc0-4dfc-89b2-4fb59dbf0099 req-44aee85b-2ab4-4194-a0a9-3ddee5acb856 service nova] Creating event network-vif-plugged:e85fffd8-bc70-45a1-bd7d-55d41cea22d2 for instance ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 on hv-cinder-85061 Sep 19 12:28:59.839702 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-8b576961-cdc0-4dfc-89b2-4fb59dbf0099 req-44aee85b-2ab4-4194-a0a9-3ddee5acb856 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032020 Sep 19 12:28:59.840358 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 163/318] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:28:59.878416 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-5cd341b7-96ac-4bff-b2a6-ffd903b2aeee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:28:59.886383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5cd341b7-96ac-4bff-b2a6-ffd903b2aeee tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1368 microversion: 2.1 time: 0.193484 Sep 19 12:28:59.887203 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 156/319] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:28:59 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:00.152904 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-37371d36-d541-4cd0-81f3-a5315222856a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:00.153911 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-37371d36-d541-4cd0-81f3-a5315222856a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:00.159670 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-37371d36-d541-4cd0-81f3-a5315222856a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:00.160150 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-37371d36-d541-4cd0-81f3-a5315222856a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:00.160580 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-37371d36-d541-4cd0-81f3-a5315222856a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:00.161320 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-37371d36-d541-4cd0-81f3-a5315222856a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:00.161771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-37371d36-d541-4cd0-81f3-a5315222856a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:00.162217 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-37371d36-d541-4cd0-81f3-a5315222856a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:00.235284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-37371d36-d541-4cd0-81f3-a5315222856a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:00.243006 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-37371d36-d541-4cd0-81f3-a5315222856a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1299 microversion: 2.1 time: 0.095338 Sep 19 12:29:00.243565 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 164/320] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:00 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:00.910511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-cfa528e7-55eb-4712-80b2-0cb89dbefedd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:00.911171 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-cfa528e7-55eb-4712-80b2-0cb89dbefedd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:00.917678 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cfa528e7-55eb-4712-80b2-0cb89dbefedd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:00.918149 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cfa528e7-55eb-4712-80b2-0cb89dbefedd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:00.918576 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cfa528e7-55eb-4712-80b2-0cb89dbefedd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:00.919256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cfa528e7-55eb-4712-80b2-0cb89dbefedd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:00.919699 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cfa528e7-55eb-4712-80b2-0cb89dbefedd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:00.920124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cfa528e7-55eb-4712-80b2-0cb89dbefedd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:01.050494 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-cfa528e7-55eb-4712-80b2-0cb89dbefedd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:01.058277 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-cfa528e7-55eb-4712-80b2-0cb89dbefedd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1368 microversion: 2.1 time: 0.151577 Sep 19 12:29:01.058855 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 157/321] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:00 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:01.265781 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a10abd28-29f2-4ab2-a4c5-8da7cdb3dc9d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:01.266315 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a10abd28-29f2-4ab2-a4c5-8da7cdb3dc9d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:01.272833 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a10abd28-29f2-4ab2-a4c5-8da7cdb3dc9d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:01.277404 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a10abd28-29f2-4ab2-a4c5-8da7cdb3dc9d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:01.277404 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a10abd28-29f2-4ab2-a4c5-8da7cdb3dc9d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:01.277404 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a10abd28-29f2-4ab2-a4c5-8da7cdb3dc9d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:01.277404 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a10abd28-29f2-4ab2-a4c5-8da7cdb3dc9d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:01.277958 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a10abd28-29f2-4ab2-a4c5-8da7cdb3dc9d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:01.404047 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-a10abd28-29f2-4ab2-a4c5-8da7cdb3dc9d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:01.412227 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a10abd28-29f2-4ab2-a4c5-8da7cdb3dc9d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1366 microversion: 2.1 time: 0.150779 Sep 19 12:29:01.412837 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 165/322] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:01 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:02.081058 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4689f53c-2b5f-4218-b3a6-cd62e0cee964 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:02.081700 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4689f53c-2b5f-4218-b3a6-cd62e0cee964 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:02.088619 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4689f53c-2b5f-4218-b3a6-cd62e0cee964 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:02.089111 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4689f53c-2b5f-4218-b3a6-cd62e0cee964 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:02.089544 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4689f53c-2b5f-4218-b3a6-cd62e0cee964 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:02.090227 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4689f53c-2b5f-4218-b3a6-cd62e0cee964 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:02.090674 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4689f53c-2b5f-4218-b3a6-cd62e0cee964 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:02.091096 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4689f53c-2b5f-4218-b3a6-cd62e0cee964 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:02.219240 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-4689f53c-2b5f-4218-b3a6-cd62e0cee964 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:02.227943 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4689f53c-2b5f-4218-b3a6-cd62e0cee964 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1368 microversion: 2.1 time: 0.150636 Sep 19 12:29:02.228561 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 158/323] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:02 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:02.435784 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a72f066d-46fb-4854-9297-aa4841248aed tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:02.436389 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a72f066d-46fb-4854-9297-aa4841248aed tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:02.442856 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a72f066d-46fb-4854-9297-aa4841248aed tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:02.443333 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a72f066d-46fb-4854-9297-aa4841248aed tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:02.443760 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a72f066d-46fb-4854-9297-aa4841248aed tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:02.444777 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a72f066d-46fb-4854-9297-aa4841248aed tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:02.444925 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a72f066d-46fb-4854-9297-aa4841248aed tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:02.445344 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a72f066d-46fb-4854-9297-aa4841248aed tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:02.575892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-a72f066d-46fb-4854-9297-aa4841248aed tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:02.584718 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a72f066d-46fb-4854-9297-aa4841248aed tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1366 microversion: 2.1 time: 0.152898 Sep 19 12:29:02.585293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 166/324] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:02 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:03.252024 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-75740e9d-9943-41a5-b7e5-5c2e22fedc36 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:03.252661 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-75740e9d-9943-41a5-b7e5-5c2e22fedc36 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:03.260480 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-75740e9d-9943-41a5-b7e5-5c2e22fedc36 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:03.261005 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-75740e9d-9943-41a5-b7e5-5c2e22fedc36 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:03.261441 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-75740e9d-9943-41a5-b7e5-5c2e22fedc36 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:03.262139 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-75740e9d-9943-41a5-b7e5-5c2e22fedc36 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:03.263114 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-75740e9d-9943-41a5-b7e5-5c2e22fedc36 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:03.263859 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-75740e9d-9943-41a5-b7e5-5c2e22fedc36 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:03.538952 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-75740e9d-9943-41a5-b7e5-5c2e22fedc36 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:03.547326 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-75740e9d-9943-41a5-b7e5-5c2e22fedc36 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1368 microversion: 2.1 time: 0.300140 Sep 19 12:29:03.547948 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 159/325] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:03 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1368 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:03.608409 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-286fad94-5566-47a2-a606-efaa3b8239b1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:03.609145 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-286fad94-5566-47a2-a606-efaa3b8239b1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:03.615964 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-286fad94-5566-47a2-a606-efaa3b8239b1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:03.616517 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-286fad94-5566-47a2-a606-efaa3b8239b1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:03.617260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-286fad94-5566-47a2-a606-efaa3b8239b1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:03.618554 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-286fad94-5566-47a2-a606-efaa3b8239b1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:03.619086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-286fad94-5566-47a2-a606-efaa3b8239b1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:03.619576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-286fad94-5566-47a2-a606-efaa3b8239b1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:03.833038 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-286fad94-5566-47a2-a606-efaa3b8239b1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:03.842172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-286fad94-5566-47a2-a606-efaa3b8239b1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1366 microversion: 2.1 time: 0.237655 Sep 19 12:29:03.843794 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 167/326] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:03 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:04.292227 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-33453b50-3333-46ae-ad42-796f76fb241c req-3a686d04-d2f5-43f2-a02c-9c537dbe3d8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddd91105-a661-4f11-9581-7ba50b06e00f", "tag": "89d94a1c-21ee-47bd-b318-aa47d5d6059b"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:29:04.302372 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-33453b50-3333-46ae-ad42-796f76fb241c req-3a686d04-d2f5-43f2-a02c-9c537dbe3d8c service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:04.302863 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-33453b50-3333-46ae-ad42-796f76fb241c req-3a686d04-d2f5-43f2-a02c-9c537dbe3d8c service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:04.303297 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-33453b50-3333-46ae-ad42-796f76fb241c req-3a686d04-d2f5-43f2-a02c-9c537dbe3d8c service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:04.318404 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-33453b50-3333-46ae-ad42-796f76fb241c req-3a686d04-d2f5-43f2-a02c-9c537dbe3d8c service nova] Creating event network-changed:89d94a1c-21ee-47bd-b318-aa47d5d6059b for instance ddd91105-a661-4f11-9581-7ba50b06e00f on hv-cinder-85061 Sep 19 12:29:04.323255 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-33453b50-3333-46ae-ad42-796f76fb241c req-3a686d04-d2f5-43f2-a02c-9c537dbe3d8c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035234 Sep 19 12:29:04.324812 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 160/327] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:29:04.571509 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-9560c28f-2735-480b-96cc-a7a4a256ddf8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:04.572270 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-9560c28f-2735-480b-96cc-a7a4a256ddf8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:04.578252 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9560c28f-2735-480b-96cc-a7a4a256ddf8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:04.578725 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9560c28f-2735-480b-96cc-a7a4a256ddf8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:04.579155 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9560c28f-2735-480b-96cc-a7a4a256ddf8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:04.579881 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9560c28f-2735-480b-96cc-a7a4a256ddf8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:04.580331 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9560c28f-2735-480b-96cc-a7a4a256ddf8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:04.580812 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9560c28f-2735-480b-96cc-a7a4a256ddf8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:04.810850 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-9560c28f-2735-480b-96cc-a7a4a256ddf8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:04.820698 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-9560c28f-2735-480b-96cc-a7a4a256ddf8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1368 microversion: 2.1 time: 0.252788 Sep 19 12:29:04.833667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 168/328] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:04 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:04.868069 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-90c2b3f4-d574-4fa8-aa10-0a70acf6d18f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:04.868936 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-90c2b3f4-d574-4fa8-aa10-0a70acf6d18f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:04.875038 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-90c2b3f4-d574-4fa8-aa10-0a70acf6d18f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:04.875659 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-90c2b3f4-d574-4fa8-aa10-0a70acf6d18f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:04.875954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-90c2b3f4-d574-4fa8-aa10-0a70acf6d18f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:04.876661 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-90c2b3f4-d574-4fa8-aa10-0a70acf6d18f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:04.877105 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-90c2b3f4-d574-4fa8-aa10-0a70acf6d18f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:04.877520 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-90c2b3f4-d574-4fa8-aa10-0a70acf6d18f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:04.881627 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:29:05.090433 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-90c2b3f4-d574-4fa8-aa10-0a70acf6d18f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:05.098139 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-90c2b3f4-d574-4fa8-aa10-0a70acf6d18f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1366 microversion: 2.1 time: 0.234329 Sep 19 12:29:05.098616 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 161/329] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:04 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:05.846366 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-023695cc-683e-403a-9db5-2c786b25a9e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:05.846366 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-023695cc-683e-403a-9db5-2c786b25a9e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:05.855672 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-023695cc-683e-403a-9db5-2c786b25a9e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:05.856300 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-023695cc-683e-403a-9db5-2c786b25a9e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:05.856836 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-023695cc-683e-403a-9db5-2c786b25a9e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:05.857726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-023695cc-683e-403a-9db5-2c786b25a9e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:05.858378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-023695cc-683e-403a-9db5-2c786b25a9e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:05.858917 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-023695cc-683e-403a-9db5-2c786b25a9e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:06.074665 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-023695cc-683e-403a-9db5-2c786b25a9e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:06.084850 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-023695cc-683e-403a-9db5-2c786b25a9e8 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1561 microversion: 2.1 time: 0.244303 Sep 19 12:29:06.086687 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 169/330] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:05 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1561 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:06.110452 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-a27d7639-ada4-4a12-8ac1-628173b35f8f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:06.111272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-a27d7639-ada4-4a12-8ac1-628173b35f8f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:06.127161 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c5052eff-4f1e-44d4-9a5e-0a59128e0926 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:06.127805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c5052eff-4f1e-44d4-9a5e-0a59128e0926 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:06.131667 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a27d7639-ada4-4a12-8ac1-628173b35f8f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:06.131667 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a27d7639-ada4-4a12-8ac1-628173b35f8f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:06.132109 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a27d7639-ada4-4a12-8ac1-628173b35f8f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:06.132940 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a27d7639-ada4-4a12-8ac1-628173b35f8f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:06.133413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a27d7639-ada4-4a12-8ac1-628173b35f8f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:06.133849 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a27d7639-ada4-4a12-8ac1-628173b35f8f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:06.145186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c5052eff-4f1e-44d4-9a5e-0a59128e0926 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:06.145186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c5052eff-4f1e-44d4-9a5e-0a59128e0926 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:06.145186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c5052eff-4f1e-44d4-9a5e-0a59128e0926 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:06.145186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c5052eff-4f1e-44d4-9a5e-0a59128e0926 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:06.145715 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c5052eff-4f1e-44d4-9a5e-0a59128e0926 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:06.145715 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c5052eff-4f1e-44d4-9a5e-0a59128e0926 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:06.291762 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-a27d7639-ada4-4a12-8ac1-628173b35f8f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.186220 Sep 19 12:29:06.292794 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 162/331] 10.222.0.93 () {58 vars in 1275 bytes} [Mon Sep 19 12:29:06 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/os-interface => generated 284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:29:06.421915 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c5052eff-4f1e-44d4-9a5e-0a59128e0926 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:06.429796 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c5052eff-4f1e-44d4-9a5e-0a59128e0926 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1366 microversion: 2.1 time: 0.311734 Sep 19 12:29:06.430378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 170/332] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:06 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:07.365187 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=4 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:29:07.365936 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=14 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:29:07.370316 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-0144ded1-679d-4905-ae3a-9d875f9c3681 req-37bc654e-8446-43f4-b901-002cd2eb2c81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5", "tag": "e85fffd8-bc70-45a1-bd7d-55d41cea22d2"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:29:07.379531 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-0144ded1-679d-4905-ae3a-9d875f9c3681 req-37bc654e-8446-43f4-b901-002cd2eb2c81 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:07.379999 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-0144ded1-679d-4905-ae3a-9d875f9c3681 req-37bc654e-8446-43f4-b901-002cd2eb2c81 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:07.380629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-0144ded1-679d-4905-ae3a-9d875f9c3681 req-37bc654e-8446-43f4-b901-002cd2eb2c81 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:07.403081 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-0144ded1-679d-4905-ae3a-9d875f9c3681 req-37bc654e-8446-43f4-b901-002cd2eb2c81 service nova] Creating event network-changed:e85fffd8-bc70-45a1-bd7d-55d41cea22d2 for instance ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 on hv-cinder-85061 Sep 19 12:29:07.410324 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-0144ded1-679d-4905-ae3a-9d875f9c3681 req-37bc654e-8446-43f4-b901-002cd2eb2c81 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045537 Sep 19 12:29:07.410930 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 163/333] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:29:07.454761 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-156a3b79-edc2-4ef6-ad4d-02f92e4f4d91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:07.455445 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-156a3b79-edc2-4ef6-ad4d-02f92e4f4d91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:07.457551 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=12 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:29:07.463278 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-156a3b79-edc2-4ef6-ad4d-02f92e4f4d91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:07.463807 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-156a3b79-edc2-4ef6-ad4d-02f92e4f4d91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:07.464174 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-156a3b79-edc2-4ef6-ad4d-02f92e4f4d91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:07.464882 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-156a3b79-edc2-4ef6-ad4d-02f92e4f4d91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:07.465325 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-156a3b79-edc2-4ef6-ad4d-02f92e4f4d91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:07.465737 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-156a3b79-edc2-4ef6-ad4d-02f92e4f4d91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:07.938453 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-156a3b79-edc2-4ef6-ad4d-02f92e4f4d91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:07.952706 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-156a3b79-edc2-4ef6-ad4d-02f92e4f4d91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1366 microversion: 2.1 time: 0.501571 Sep 19 12:29:07.953876 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 171/334] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:07 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1366 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:08.977125 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-74bfc767-fc2f-4533-8967-eee008a328b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:08.977807 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-74bfc767-fc2f-4533-8967-eee008a328b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:08.984847 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-74bfc767-fc2f-4533-8967-eee008a328b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:08.985339 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-74bfc767-fc2f-4533-8967-eee008a328b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:08.985773 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-74bfc767-fc2f-4533-8967-eee008a328b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:08.986481 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-74bfc767-fc2f-4533-8967-eee008a328b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:08.986965 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-74bfc767-fc2f-4533-8967-eee008a328b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:08.987350 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-74bfc767-fc2f-4533-8967-eee008a328b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:09.134564 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-74bfc767-fc2f-4533-8967-eee008a328b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:09.147348 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-74bfc767-fc2f-4533-8967-eee008a328b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1366 microversion: 2.1 time: 0.172348 Sep 19 12:29:09.147348 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 164/335] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:08 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:10.170183 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-928e0b9f-8593-4c79-ae38-bc02cedf3e23 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:10.176953 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-928e0b9f-8593-4c79-ae38-bc02cedf3e23 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:10.178691 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-928e0b9f-8593-4c79-ae38-bc02cedf3e23 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:10.179180 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-928e0b9f-8593-4c79-ae38-bc02cedf3e23 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:10.179609 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-928e0b9f-8593-4c79-ae38-bc02cedf3e23 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:10.180306 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-928e0b9f-8593-4c79-ae38-bc02cedf3e23 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:10.181445 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-928e0b9f-8593-4c79-ae38-bc02cedf3e23 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:10.181865 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-928e0b9f-8593-4c79-ae38-bc02cedf3e23 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:10.331854 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-928e0b9f-8593-4c79-ae38-bc02cedf3e23 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:10.340238 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-928e0b9f-8593-4c79-ae38-bc02cedf3e23 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1366 microversion: 2.1 time: 0.174050 Sep 19 12:29:10.340861 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 172/336] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:10 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:11.364235 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-a38632e0-9e64-486e-a36d-d90ccd3c7b51 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:11.364993 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-a38632e0-9e64-486e-a36d-d90ccd3c7b51 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:11.371762 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a38632e0-9e64-486e-a36d-d90ccd3c7b51 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:11.372205 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a38632e0-9e64-486e-a36d-d90ccd3c7b51 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:11.372622 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a38632e0-9e64-486e-a36d-d90ccd3c7b51 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:11.373564 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a38632e0-9e64-486e-a36d-d90ccd3c7b51 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:11.373946 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a38632e0-9e64-486e-a36d-d90ccd3c7b51 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:11.374371 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a38632e0-9e64-486e-a36d-d90ccd3c7b51 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:11.516932 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-a38632e0-9e64-486e-a36d-d90ccd3c7b51 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:11.525232 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-a38632e0-9e64-486e-a36d-d90ccd3c7b51 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1366 microversion: 2.1 time: 0.165202 Sep 19 12:29:11.525967 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 165/337] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:11 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:11.580869 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-7d85668f-e200-4e85-8ae4-08fae5973a71 req-4ff16bf9-5aa8-468f-9985-5e61537c04a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd91105-a661-4f11-9581-7ba50b06e00f", "name": "network-vif-plugged", "status": "completed", "tag": "89d94a1c-21ee-47bd-b318-aa47d5d6059b"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:29:11.591911 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-7d85668f-e200-4e85-8ae4-08fae5973a71 req-4ff16bf9-5aa8-468f-9985-5e61537c04a9 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:11.596190 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-7d85668f-e200-4e85-8ae4-08fae5973a71 req-4ff16bf9-5aa8-468f-9985-5e61537c04a9 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:11.596190 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-7d85668f-e200-4e85-8ae4-08fae5973a71 req-4ff16bf9-5aa8-468f-9985-5e61537c04a9 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:11.605383 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-7d85668f-e200-4e85-8ae4-08fae5973a71 req-4ff16bf9-5aa8-468f-9985-5e61537c04a9 service nova] Creating event network-vif-plugged:89d94a1c-21ee-47bd-b318-aa47d5d6059b for instance ddd91105-a661-4f11-9581-7ba50b06e00f on hv-cinder-85061 Sep 19 12:29:11.611133 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-7d85668f-e200-4e85-8ae4-08fae5973a71 req-4ff16bf9-5aa8-468f-9985-5e61537c04a9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035666 Sep 19 12:29:11.611930 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 173/338] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:29:12.557036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-101aa170-ea04-4c7d-b18b-a5e4aeefc4d4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:12.557745 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-101aa170-ea04-4c7d-b18b-a5e4aeefc4d4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:12.564946 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:29:12.570125 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-101aa170-ea04-4c7d-b18b-a5e4aeefc4d4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:12.570615 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-101aa170-ea04-4c7d-b18b-a5e4aeefc4d4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:12.571130 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-101aa170-ea04-4c7d-b18b-a5e4aeefc4d4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:12.572270 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-101aa170-ea04-4c7d-b18b-a5e4aeefc4d4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:12.572763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-101aa170-ea04-4c7d-b18b-a5e4aeefc4d4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:12.573196 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-101aa170-ea04-4c7d-b18b-a5e4aeefc4d4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:12.714570 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-101aa170-ea04-4c7d-b18b-a5e4aeefc4d4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:12.722760 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-101aa170-ea04-4c7d-b18b-a5e4aeefc4d4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1366 microversion: 2.1 time: 0.177816 Sep 19 12:29:12.723340 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 166/339] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:12 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:13.746703 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c4f9c4c9-cdb6-4b40-9cbe-30b58e98969a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:13.747421 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c4f9c4c9-cdb6-4b40-9cbe-30b58e98969a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:13.754516 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c4f9c4c9-cdb6-4b40-9cbe-30b58e98969a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:13.755038 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c4f9c4c9-cdb6-4b40-9cbe-30b58e98969a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:13.755526 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c4f9c4c9-cdb6-4b40-9cbe-30b58e98969a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:13.759487 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c4f9c4c9-cdb6-4b40-9cbe-30b58e98969a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:13.759487 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c4f9c4c9-cdb6-4b40-9cbe-30b58e98969a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:13.759487 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c4f9c4c9-cdb6-4b40-9cbe-30b58e98969a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:13.895593 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c4f9c4c9-cdb6-4b40-9cbe-30b58e98969a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:13.903587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c4f9c4c9-cdb6-4b40-9cbe-30b58e98969a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1366 microversion: 2.1 time: 0.161701 Sep 19 12:29:13.904324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 174/340] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:13 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:14.926520 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-de3d4544-9642-4c30-af51-6363a35fdfe3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:14.927283 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-de3d4544-9642-4c30-af51-6363a35fdfe3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:14.934235 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-de3d4544-9642-4c30-af51-6363a35fdfe3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:14.934717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-de3d4544-9642-4c30-af51-6363a35fdfe3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:14.935146 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-de3d4544-9642-4c30-af51-6363a35fdfe3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:14.935834 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-de3d4544-9642-4c30-af51-6363a35fdfe3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:14.936282 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-de3d4544-9642-4c30-af51-6363a35fdfe3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:14.936779 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-de3d4544-9642-4c30-af51-6363a35fdfe3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:15.074530 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-de3d4544-9642-4c30-af51-6363a35fdfe3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:15.083619 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-de3d4544-9642-4c30-af51-6363a35fdfe3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1555 microversion: 2.1 time: 0.160261 Sep 19 12:29:15.084217 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 167/341] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:14 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:15.107755 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-723c0387-b0ce-4526-88d3-d19090357590 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:15.108265 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-723c0387-b0ce-4526-88d3-d19090357590 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:15.114840 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-723c0387-b0ce-4526-88d3-d19090357590 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:15.115317 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-723c0387-b0ce-4526-88d3-d19090357590 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:15.115744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-723c0387-b0ce-4526-88d3-d19090357590 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:15.116424 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-723c0387-b0ce-4526-88d3-d19090357590 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:15.116900 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-723c0387-b0ce-4526-88d3-d19090357590 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:15.117382 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-723c0387-b0ce-4526-88d3-d19090357590 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:15.197177 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-723c0387-b0ce-4526-88d3-d19090357590 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092807 Sep 19 12:29:15.197779 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 175/342] 10.222.0.93 () {58 vars in 1275 bytes} [Mon Sep 19 12:29:15 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:29:16.847221 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-faf31744-5221-4161-a1cc-c37ce8e47854 req-561f7bfe-57ef-4f82-96d0-fa66487c91f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddd91105-a661-4f11-9581-7ba50b06e00f", "tag": "89d94a1c-21ee-47bd-b318-aa47d5d6059b"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:29:16.858763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-faf31744-5221-4161-a1cc-c37ce8e47854 req-561f7bfe-57ef-4f82-96d0-fa66487c91f8 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:16.860083 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-faf31744-5221-4161-a1cc-c37ce8e47854 req-561f7bfe-57ef-4f82-96d0-fa66487c91f8 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:16.860083 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-faf31744-5221-4161-a1cc-c37ce8e47854 req-561f7bfe-57ef-4f82-96d0-fa66487c91f8 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:16.871751 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-faf31744-5221-4161-a1cc-c37ce8e47854 req-561f7bfe-57ef-4f82-96d0-fa66487c91f8 service nova] Creating event network-changed:89d94a1c-21ee-47bd-b318-aa47d5d6059b for instance ddd91105-a661-4f11-9581-7ba50b06e00f on hv-cinder-85061 Sep 19 12:29:16.877705 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-faf31744-5221-4161-a1cc-c37ce8e47854 req-561f7bfe-57ef-4f82-96d0-fa66487c91f8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034484 Sep 19 12:29:16.879296 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 168/343] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:29:49.276608 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=27 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:29:49.277394 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=95 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:29:49.278657 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:29:49.278794 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Mon Sep 19 12:29:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/os-volume_attachments/31d137ff-b153-4b85-94cc-5b327cbe7332 (ip 10.222.0.93) !!! Sep 19 12:29:49.284294 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-13eede84-c356-4df7-a4b7-33163ee7e8cf tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:49.285003 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-13eede84-c356-4df7-a4b7-33163ee7e8cf tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:49.293922 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-13eede84-c356-4df7-a4b7-33163ee7e8cf tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:49.294403 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-13eede84-c356-4df7-a4b7-33163ee7e8cf tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:49.297934 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-13eede84-c356-4df7-a4b7-33163ee7e8cf tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:49.297934 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-13eede84-c356-4df7-a4b7-33163ee7e8cf tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:49.297934 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-13eede84-c356-4df7-a4b7-33163ee7e8cf tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:49.297934 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-13eede84-c356-4df7-a4b7-33163ee7e8cf tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:49.424044 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-13eede84-c356-4df7-a4b7-33163ee7e8cf tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lazy-loading 'services' on Instance uuid ded9ef48-10a2-4c68-bf0b-ad0e02e36308 {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:29:49.741112 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-13eede84-c356-4df7-a4b7-33163ee7e8cf tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/os-volume_attachments/31d137ff-b153-4b85-94cc-5b327cbe7332" status: 202 len: 0 microversion: 2.1 time: 0.466368 Sep 19 12:29:49.744512 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 176/344] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Sep 19 12:29:49 2022] DELETE /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/os-volume_attachments/31d137ff-b153-4b85-94cc-5b327cbe7332 => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:29:51.940885 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4819e913-31d9-485f-ad9a-11109b4dbac9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:29:51.944247 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=5 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:29:51.944247 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=36 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:29:51.945113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:29:51.945113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Mon Sep 19 12:29:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/action (ip 10.222.0.93) !!! Sep 19 12:29:51.951201 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4819e913-31d9-485f-ad9a-11109b4dbac9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:51.951759 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4819e913-31d9-485f-ad9a-11109b4dbac9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:51.952271 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4819e913-31d9-485f-ad9a-11109b4dbac9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:52.018145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4819e913-31d9-485f-ad9a-11109b4dbac9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Going to try to stop instance {{(pid=121429) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 12:29:52.222753 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4819e913-31d9-485f-ad9a-11109b4dbac9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "POST /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/action" status: 202 len: 0 microversion: 2.1 time: 0.285697 Sep 19 12:29:52.223324 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 169/345] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Sep 19 12:29:51 2022] POST /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:29:52.233942 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-81ba2e75-13bf-4303-bcf8-35b9f741fd38 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:52.235896 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-81ba2e75-13bf-4303-bcf8-35b9f741fd38 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:52.242865 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81ba2e75-13bf-4303-bcf8-35b9f741fd38 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:52.243506 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81ba2e75-13bf-4303-bcf8-35b9f741fd38 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:52.243980 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81ba2e75-13bf-4303-bcf8-35b9f741fd38 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:52.244746 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81ba2e75-13bf-4303-bcf8-35b9f741fd38 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:52.245265 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81ba2e75-13bf-4303-bcf8-35b9f741fd38 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:52.245689 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81ba2e75-13bf-4303-bcf8-35b9f741fd38 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:52.413786 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-81ba2e75-13bf-4303-bcf8-35b9f741fd38 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:52.423463 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-81ba2e75-13bf-4303-bcf8-35b9f741fd38 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1676 microversion: 2.1 time: 0.194697 Sep 19 12:29:52.433109 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 177/346] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:52 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1676 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:53.448703 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-0893f50c-614a-4d35-b309-691e1b2c03d0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:53.451678 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-0893f50c-614a-4d35-b309-691e1b2c03d0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:53.455948 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0893f50c-614a-4d35-b309-691e1b2c03d0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:53.456431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0893f50c-614a-4d35-b309-691e1b2c03d0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:53.456880 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0893f50c-614a-4d35-b309-691e1b2c03d0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:53.457581 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0893f50c-614a-4d35-b309-691e1b2c03d0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:53.458025 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0893f50c-614a-4d35-b309-691e1b2c03d0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:53.458441 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0893f50c-614a-4d35-b309-691e1b2c03d0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:53.612421 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-0893f50c-614a-4d35-b309-691e1b2c03d0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:53.620855 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-0893f50c-614a-4d35-b309-691e1b2c03d0 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1676 microversion: 2.1 time: 0.177084 Sep 19 12:29:53.621431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 170/347] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:53 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:54.645677 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b8d1fb18-2075-4b8a-8834-0e207eb9dbce tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:54.646284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-b8d1fb18-2075-4b8a-8834-0e207eb9dbce tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:54.653360 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b8d1fb18-2075-4b8a-8834-0e207eb9dbce tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:54.654012 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b8d1fb18-2075-4b8a-8834-0e207eb9dbce tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:54.654449 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b8d1fb18-2075-4b8a-8834-0e207eb9dbce tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:54.655138 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b8d1fb18-2075-4b8a-8834-0e207eb9dbce tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:54.655591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b8d1fb18-2075-4b8a-8834-0e207eb9dbce tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:54.656011 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b8d1fb18-2075-4b8a-8834-0e207eb9dbce tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:54.791304 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-b8d1fb18-2075-4b8a-8834-0e207eb9dbce tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:54.799183 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-b8d1fb18-2075-4b8a-8834-0e207eb9dbce tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1676 microversion: 2.1 time: 0.157394 Sep 19 12:29:54.799743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 178/348] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:54 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:55.823513 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-8b8bd372-0c41-4a60-9081-46e2a3212d96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:55.824124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-8b8bd372-0c41-4a60-9081-46e2a3212d96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:55.830534 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8b8bd372-0c41-4a60-9081-46e2a3212d96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:55.831015 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8b8bd372-0c41-4a60-9081-46e2a3212d96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:55.831450 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8b8bd372-0c41-4a60-9081-46e2a3212d96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:55.832132 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8b8bd372-0c41-4a60-9081-46e2a3212d96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:55.832582 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8b8bd372-0c41-4a60-9081-46e2a3212d96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:55.833099 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8b8bd372-0c41-4a60-9081-46e2a3212d96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:55.958066 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8b8bd372-0c41-4a60-9081-46e2a3212d96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:55.966011 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-8b8bd372-0c41-4a60-9081-46e2a3212d96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1676 microversion: 2.1 time: 0.146986 Sep 19 12:29:55.966575 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 171/349] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:55 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:56.989980 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f4d820d5-6c25-4f94-be67-0f8b4469f966 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:56.990649 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f4d820d5-6c25-4f94-be67-0f8b4469f966 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:56.997901 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4d820d5-6c25-4f94-be67-0f8b4469f966 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:57.001315 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4d820d5-6c25-4f94-be67-0f8b4469f966 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:57.001315 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4d820d5-6c25-4f94-be67-0f8b4469f966 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:57.001315 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4d820d5-6c25-4f94-be67-0f8b4469f966 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:57.001315 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4d820d5-6c25-4f94-be67-0f8b4469f966 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:57.001686 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4d820d5-6c25-4f94-be67-0f8b4469f966 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:57.128361 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f4d820d5-6c25-4f94-be67-0f8b4469f966 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:57.135924 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f4d820d5-6c25-4f94-be67-0f8b4469f966 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1676 microversion: 2.1 time: 0.149734 Sep 19 12:29:57.136486 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 179/350] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:56 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:58.159320 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-456523fa-cb9c-4184-80d6-8fb73e98844e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:58.159929 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-456523fa-cb9c-4184-80d6-8fb73e98844e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:58.166909 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-456523fa-cb9c-4184-80d6-8fb73e98844e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:58.167396 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-456523fa-cb9c-4184-80d6-8fb73e98844e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:58.167832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-456523fa-cb9c-4184-80d6-8fb73e98844e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:58.168521 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-456523fa-cb9c-4184-80d6-8fb73e98844e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:58.169017 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-456523fa-cb9c-4184-80d6-8fb73e98844e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:58.169444 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-456523fa-cb9c-4184-80d6-8fb73e98844e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:58.301891 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-456523fa-cb9c-4184-80d6-8fb73e98844e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:58.310486 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-456523fa-cb9c-4184-80d6-8fb73e98844e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1676 microversion: 2.1 time: 0.154957 Sep 19 12:29:58.311549 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 172/351] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:58 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:29:59.334446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f4ad1b15-d4e8-4b17-8cf8-4f696816d3bc tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:29:59.335275 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f4ad1b15-d4e8-4b17-8cf8-4f696816d3bc tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:29:59.342348 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4ad1b15-d4e8-4b17-8cf8-4f696816d3bc tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:59.342822 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4ad1b15-d4e8-4b17-8cf8-4f696816d3bc tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:59.343247 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4ad1b15-d4e8-4b17-8cf8-4f696816d3bc tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:59.343924 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4ad1b15-d4e8-4b17-8cf8-4f696816d3bc tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:29:59.344363 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4ad1b15-d4e8-4b17-8cf8-4f696816d3bc tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:29:59.344804 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4ad1b15-d4e8-4b17-8cf8-4f696816d3bc tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:29:59.480257 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f4ad1b15-d4e8-4b17-8cf8-4f696816d3bc tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:29:59.488660 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f4ad1b15-d4e8-4b17-8cf8-4f696816d3bc tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1676 microversion: 2.1 time: 0.157996 Sep 19 12:29:59.489228 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 180/352] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:29:59 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:00.512260 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-f677ce2a-def2-45fc-beed-d4348fa2a34e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:00.512915 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-f677ce2a-def2-45fc-beed-d4348fa2a34e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:00.519549 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f677ce2a-def2-45fc-beed-d4348fa2a34e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:00.520036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f677ce2a-def2-45fc-beed-d4348fa2a34e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:00.520495 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f677ce2a-def2-45fc-beed-d4348fa2a34e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:00.521280 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f677ce2a-def2-45fc-beed-d4348fa2a34e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:00.521742 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f677ce2a-def2-45fc-beed-d4348fa2a34e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:00.522190 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f677ce2a-def2-45fc-beed-d4348fa2a34e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:00.651484 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-f677ce2a-def2-45fc-beed-d4348fa2a34e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:00.659488 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-f677ce2a-def2-45fc-beed-d4348fa2a34e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1676 microversion: 2.1 time: 0.151970 Sep 19 12:30:00.664308 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 173/353] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:00 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:01.684081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-af9fc69b-2161-483a-a3ad-96e8b97ac9be tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:01.684744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-af9fc69b-2161-483a-a3ad-96e8b97ac9be tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:01.691317 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-af9fc69b-2161-483a-a3ad-96e8b97ac9be tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:01.691797 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-af9fc69b-2161-483a-a3ad-96e8b97ac9be tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:01.692972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-af9fc69b-2161-483a-a3ad-96e8b97ac9be tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:01.693680 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-af9fc69b-2161-483a-a3ad-96e8b97ac9be tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:01.694580 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-af9fc69b-2161-483a-a3ad-96e8b97ac9be tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:01.695140 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-af9fc69b-2161-483a-a3ad-96e8b97ac9be tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:01.839697 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-af9fc69b-2161-483a-a3ad-96e8b97ac9be tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:01.848577 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-af9fc69b-2161-483a-a3ad-96e8b97ac9be tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1676 microversion: 2.1 time: 0.168778 Sep 19 12:30:01.851908 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 181/354] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:01 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:02.872245 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-56204b18-2f90-4caa-9df9-e2574f611048 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:02.873628 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-56204b18-2f90-4caa-9df9-e2574f611048 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:02.880370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-56204b18-2f90-4caa-9df9-e2574f611048 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:02.881322 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-56204b18-2f90-4caa-9df9-e2574f611048 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:02.881967 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-56204b18-2f90-4caa-9df9-e2574f611048 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:02.882671 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-56204b18-2f90-4caa-9df9-e2574f611048 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:02.883121 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-56204b18-2f90-4caa-9df9-e2574f611048 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:02.884264 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-56204b18-2f90-4caa-9df9-e2574f611048 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:03.037419 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-56204b18-2f90-4caa-9df9-e2574f611048 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:03.046473 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-56204b18-2f90-4caa-9df9-e2574f611048 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1676 microversion: 2.1 time: 0.177979 Sep 19 12:30:03.047510 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 174/355] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:02 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:03.597433 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-60cc0d2e-dc6b-4f04-b361-9c6f9eb5e720 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2184f08-7c84-48ac-9dc6-bfdb1169ab22"}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:03.606316 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-60cc0d2e-dc6b-4f04-b361-9c6f9eb5e720 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:03.607714 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-60cc0d2e-dc6b-4f04-b361-9c6f9eb5e720 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:03.608219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-60cc0d2e-dc6b-4f04-b361-9c6f9eb5e720 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:03.608761 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-60cc0d2e-dc6b-4f04-b361-9c6f9eb5e720 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:03.609485 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-60cc0d2e-dc6b-4f04-b361-9c6f9eb5e720 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:03.609970 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-60cc0d2e-dc6b-4f04-b361-9c6f9eb5e720 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:03.610650 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-60cc0d2e-dc6b-4f04-b361-9c6f9eb5e720 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:04.072146 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5a0a33d6-5ed5-4b10-ac33-4b3b5a507841 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:04.073603 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-5a0a33d6-5ed5-4b10-ac33-4b3b5a507841 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:04.081284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5a0a33d6-5ed5-4b10-ac33-4b3b5a507841 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:04.081757 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5a0a33d6-5ed5-4b10-ac33-4b3b5a507841 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:04.082504 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5a0a33d6-5ed5-4b10-ac33-4b3b5a507841 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:04.083379 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5a0a33d6-5ed5-4b10-ac33-4b3b5a507841 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:04.083846 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5a0a33d6-5ed5-4b10-ac33-4b3b5a507841 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:04.084259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5a0a33d6-5ed5-4b10-ac33-4b3b5a507841 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:04.252065 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-5a0a33d6-5ed5-4b10-ac33-4b3b5a507841 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:04.259773 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5a0a33d6-5ed5-4b10-ac33-4b3b5a507841 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1676 microversion: 2.1 time: 0.192587 Sep 19 12:30:04.260336 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 175/356] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:04 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1676 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:30:04.484152 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-60cc0d2e-dc6b-4f04-b361-9c6f9eb5e720 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "POST /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.891950 Sep 19 12:30:04.485182 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 182/357] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Sep 19 12:30:03 2022] POST /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/os-volume_attachments => generated 194 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:30:05.284363 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2ac0603c-b29a-4cef-b67d-4a2cfb9f04c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:05.285148 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2ac0603c-b29a-4cef-b67d-4a2cfb9f04c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:05.293134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2ac0603c-b29a-4cef-b67d-4a2cfb9f04c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:05.293633 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2ac0603c-b29a-4cef-b67d-4a2cfb9f04c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:05.294076 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2ac0603c-b29a-4cef-b67d-4a2cfb9f04c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:05.294786 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2ac0603c-b29a-4cef-b67d-4a2cfb9f04c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:05.295236 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2ac0603c-b29a-4cef-b67d-4a2cfb9f04c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:05.295873 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2ac0603c-b29a-4cef-b67d-4a2cfb9f04c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:05.485231 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2ac0603c-b29a-4cef-b67d-4a2cfb9f04c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:05.493676 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2ac0603c-b29a-4cef-b67d-4a2cfb9f04c3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1676 microversion: 2.1 time: 0.213395 Sep 19 12:30:05.494260 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 176/358] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:05 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1676 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:06.518153 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-25f81f4e-4896-4c71-8fb1-af48e574306f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:06.518909 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-25f81f4e-4896-4c71-8fb1-af48e574306f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:06.526648 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-25f81f4e-4896-4c71-8fb1-af48e574306f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:06.527373 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-25f81f4e-4896-4c71-8fb1-af48e574306f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:06.527807 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-25f81f4e-4896-4c71-8fb1-af48e574306f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:06.528704 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-25f81f4e-4896-4c71-8fb1-af48e574306f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:06.528959 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-25f81f4e-4896-4c71-8fb1-af48e574306f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:06.529374 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-25f81f4e-4896-4c71-8fb1-af48e574306f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:06.665700 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-25f81f4e-4896-4c71-8fb1-af48e574306f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:06.677479 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-25f81f4e-4896-4c71-8fb1-af48e574306f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1676 microversion: 2.1 time: 0.163562 Sep 19 12:30:06.678261 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 183/359] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:06 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:07.701321 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-250d73f8-fb73-478a-8660-0ed2113c0f16 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:07.702044 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-250d73f8-fb73-478a-8660-0ed2113c0f16 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:07.710648 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-250d73f8-fb73-478a-8660-0ed2113c0f16 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:07.711968 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-250d73f8-fb73-478a-8660-0ed2113c0f16 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:07.712565 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-250d73f8-fb73-478a-8660-0ed2113c0f16 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:07.713871 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-250d73f8-fb73-478a-8660-0ed2113c0f16 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:07.714493 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-250d73f8-fb73-478a-8660-0ed2113c0f16 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:07.715330 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-250d73f8-fb73-478a-8660-0ed2113c0f16 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:07.894906 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-250d73f8-fb73-478a-8660-0ed2113c0f16 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:07.925847 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-250d73f8-fb73-478a-8660-0ed2113c0f16 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1676 microversion: 2.1 time: 0.228358 Sep 19 12:30:07.933515 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 177/360] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:07 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1676 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:08.965058 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-759ae0e0-0ec1-4d71-921f-5979b2539403 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:08.965608 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-759ae0e0-0ec1-4d71-921f-5979b2539403 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:08.972287 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-759ae0e0-0ec1-4d71-921f-5979b2539403 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:08.972804 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-759ae0e0-0ec1-4d71-921f-5979b2539403 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:08.973240 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-759ae0e0-0ec1-4d71-921f-5979b2539403 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:08.973939 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-759ae0e0-0ec1-4d71-921f-5979b2539403 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:08.974383 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-759ae0e0-0ec1-4d71-921f-5979b2539403 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:08.974811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-759ae0e0-0ec1-4d71-921f-5979b2539403 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:09.160370 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-759ae0e0-0ec1-4d71-921f-5979b2539403 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:09.169436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-759ae0e0-0ec1-4d71-921f-5979b2539403 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1653 microversion: 2.1 time: 0.208432 Sep 19 12:30:09.170018 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 184/361] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:08 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1653 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:30:09.197260 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-00983bfa-9505-427e-9860-8a73b18ea12f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:09.204760 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-00983bfa-9505-427e-9860-8a73b18ea12f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:09.205256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-00983bfa-9505-427e-9860-8a73b18ea12f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:09.205689 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-00983bfa-9505-427e-9860-8a73b18ea12f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:09.234076 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-00983bfa-9505-427e-9860-8a73b18ea12f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Going to try to start instance {{(pid=121429) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 12:30:09.596039 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-00983bfa-9505-427e-9860-8a73b18ea12f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "POST /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/action" status: 202 len: 0 microversion: 2.1 time: 0.403340 Sep 19 12:30:09.612986 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-99839cd7-b942-44e1-867c-9007570eed6f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:09.613435 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 178/362] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Sep 19 12:30:09 2022] POST /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 12:30:09.614630 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-99839cd7-b942-44e1-867c-9007570eed6f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:09.630398 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-99839cd7-b942-44e1-867c-9007570eed6f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:09.632845 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-99839cd7-b942-44e1-867c-9007570eed6f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:09.633824 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-99839cd7-b942-44e1-867c-9007570eed6f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:09.634554 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-99839cd7-b942-44e1-867c-9007570eed6f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:09.635010 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-99839cd7-b942-44e1-867c-9007570eed6f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:09.635507 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-99839cd7-b942-44e1-867c-9007570eed6f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:09.842552 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-99839cd7-b942-44e1-867c-9007570eed6f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:09.858606 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-99839cd7-b942-44e1-867c-9007570eed6f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1662 microversion: 2.1 time: 0.256444 Sep 19 12:30:09.859246 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 185/363] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:09 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1662 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:10.885022 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-aaf96760-e1c6-4b61-9f9b-bda2c3c58d72 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:10.885736 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-aaf96760-e1c6-4b61-9f9b-bda2c3c58d72 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:10.894103 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aaf96760-e1c6-4b61-9f9b-bda2c3c58d72 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:10.895003 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aaf96760-e1c6-4b61-9f9b-bda2c3c58d72 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:10.895614 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aaf96760-e1c6-4b61-9f9b-bda2c3c58d72 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:10.896573 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aaf96760-e1c6-4b61-9f9b-bda2c3c58d72 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:10.897046 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aaf96760-e1c6-4b61-9f9b-bda2c3c58d72 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:10.897636 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aaf96760-e1c6-4b61-9f9b-bda2c3c58d72 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:11.062598 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-aaf96760-e1c6-4b61-9f9b-bda2c3c58d72 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:11.072449 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-aaf96760-e1c6-4b61-9f9b-bda2c3c58d72 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1662 microversion: 2.1 time: 0.192941 Sep 19 12:30:11.073667 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 179/364] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:10 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1662 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:12.098217 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8e54f348-90f8-4194-84d7-430cce860d30 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:12.100307 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-8e54f348-90f8-4194-84d7-430cce860d30 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:12.137695 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8e54f348-90f8-4194-84d7-430cce860d30 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:12.140021 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8e54f348-90f8-4194-84d7-430cce860d30 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:12.141365 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8e54f348-90f8-4194-84d7-430cce860d30 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:12.142636 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8e54f348-90f8-4194-84d7-430cce860d30 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:12.144400 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8e54f348-90f8-4194-84d7-430cce860d30 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:12.145237 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8e54f348-90f8-4194-84d7-430cce860d30 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:12.193575 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3f50d1f0-5f5b-4550-8714-2fa457f81e5c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:12.195494 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3f50d1f0-5f5b-4550-8714-2fa457f81e5c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:12.207886 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3f50d1f0-5f5b-4550-8714-2fa457f81e5c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:12.208868 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3f50d1f0-5f5b-4550-8714-2fa457f81e5c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:12.214315 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3f50d1f0-5f5b-4550-8714-2fa457f81e5c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:12.214315 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3f50d1f0-5f5b-4550-8714-2fa457f81e5c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:12.214315 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3f50d1f0-5f5b-4550-8714-2fa457f81e5c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:12.214315 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3f50d1f0-5f5b-4550-8714-2fa457f81e5c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:12.275634 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3f50d1f0-5f5b-4550-8714-2fa457f81e5c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f/ips" status: 200 len: 148 microversion: 2.1 time: 0.089165 Sep 19 12:30:12.277270 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 180/365] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Sep 19 12:30:12 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f/ips => generated 148 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:30:12.292407 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-33f20692-fa02-4e44-8f40-7279c3a063fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36194571-1d0e-4b41-a304-cb1f03f5b37b"}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:12.295327 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-33f20692-fa02-4e44-8f40-7279c3a063fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:12.309239 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33f20692-fa02-4e44-8f40-7279c3a063fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:12.311000 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33f20692-fa02-4e44-8f40-7279c3a063fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:12.316288 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33f20692-fa02-4e44-8f40-7279c3a063fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:12.316288 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33f20692-fa02-4e44-8f40-7279c3a063fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:12.316288 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33f20692-fa02-4e44-8f40-7279c3a063fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:12.316288 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33f20692-fa02-4e44-8f40-7279c3a063fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:12.422188 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-8e54f348-90f8-4194-84d7-430cce860d30 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:12.432777 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8e54f348-90f8-4194-84d7-430cce860d30 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1666 microversion: 2.1 time: 0.338687 Sep 19 12:30:12.436499 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 186/366] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:12 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1666 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:12.452485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-33f20692-fa02-4e44-8f40-7279c3a063fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] HTTP exception thrown: Invalid volume: volume 36194571-1d0e-4b41-a304-cb1f03f5b37b is already attached to instances: a4930060-ddb1-4835-a231-ea79ffb14068 Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-33f20692-fa02-4e44-8f40-7279c3a063fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Request method failure captured: Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: POST /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f/os-volume_attachments HTTP/1.1 Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 74 Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKF_xba_JzZBCLNYzS-MR7i3MH3BmQnGBrtpnxxJ02XYU-aLwAMxUp37Js2oVsjZH1Xi2UqEV1PX4cz9KrfQYP2FUn0P4VJxchdxu1X2bfyWUsNGE-kHp0diwIJQq10d4xyW6w1vIK1PG2u4EnZQQclxeJyL0DgqKkwpL098U-5D5sHs Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:30:12.455284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:30:12.457001 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_68496d9aa29542139f00104051248a5b", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/68496d9aa29542139f00104051248a5b"}]}] Sep 19 12:30:12.457001 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:30:12.457001 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:30:12.457001 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:30:12.457001 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:30:12.457001 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:30:12.457001 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:30:12.457001 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 3a48e0ab477f43d294607d441af0b444 Sep 19 12:30:12.457001 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:30:12.457001 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Sep 19 12:30:12.457001 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {"volumeAttachment": {"volumeId": "36194571-1d0e-4b41-a304-cb1f03f5b37b"}} Sep 19 12:30:12.457001 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:30:12.457910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Invalid volume: volume 36194571-1d0e-4b41-a304-cb1f03f5b37b is already attached to instances: a4930060-ddb1-4835-a231-ea79ffb14068 Sep 19 12:30:12.457910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'server_id': 'ddd91105-a661-4f11-9581-7ba50b06e00f', 'body': {'volumeAttachment': {'volumeId': '36194571-1d0e-4b41-a304-cb1f03f5b37b'}}} Sep 19 12:30:12.457910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:30:12.457910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:30:12.457910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 12:30:12.457910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 12:30:12.457910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 12:30:12.457910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 12:30:12.457910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 12:30:12.457910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 12:30:12.457910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 19 12:30:12.457910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 19 12:30:12.457910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 19 12:30:12.457910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 19 12:30:12.457910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 36194571-1d0e-4b41-a304-cb1f03f5b37b is already attached to instances: a4930060-ddb1-4835-a231-ea79ffb14068 Sep 19 12:30:12.457910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:12.457910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:30:12.457910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:12.457910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 36194571-1d0e-4b41-a304-cb1f03f5b37b is already attached to instances: a4930060-ddb1-4835-a231-ea79ffb14068 Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:30:12.459413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:30:12.460800 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:30:12.460800 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:30:12.460800 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:30:12.460800 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 36194571-1d0e-4b41-a304-cb1f03f5b37b is already attached to instances: a4930060-ddb1-4835-a231-ea79ffb14068 Sep 19 12:30:12.460800 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:12.460800 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-33f20692-fa02-4e44-8f40-7279c3a063fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Returning 400 to user: Invalid volume: volume 36194571-1d0e-4b41-a304-cb1f03f5b37b is already attached to instances: a4930060-ddb1-4835-a231-ea79ffb14068 {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:30:12.460800 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-33f20692-fa02-4e44-8f40-7279c3a063fa tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "POST /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.171962 Sep 19 12:30:12.464874 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 181/367] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Sep 19 12:30:12 2022] POST /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f/os-volume_attachments => generated 174 bytes in 180 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:30:12.467114 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-79f23190-fcf4-4944-8d6a-908952d340d1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:12.467625 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-79f23190-fcf4-4944-8d6a-908952d340d1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:12.474220 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-79f23190-fcf4-4944-8d6a-908952d340d1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:12.474854 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-79f23190-fcf4-4944-8d6a-908952d340d1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:12.475298 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-79f23190-fcf4-4944-8d6a-908952d340d1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:12.476011 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-79f23190-fcf4-4944-8d6a-908952d340d1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:12.476462 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-79f23190-fcf4-4944-8d6a-908952d340d1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:12.477438 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-79f23190-fcf4-4944-8d6a-908952d340d1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:12.505732 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-79f23190-fcf4-4944-8d6a-908952d340d1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Going to try to terminate instance {{(pid=121428) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:30:12.945938 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-79f23190-fcf4-4944-8d6a-908952d340d1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 204 len: 0 microversion: 2.1 time: 0.482318 Sep 19 12:30:12.948468 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 187/368] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:30:12 2022] DELETE /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:30:12.956751 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-7302875a-9047-43ee-800e-5968f59bcdf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:12.957417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-7302875a-9047-43ee-800e-5968f59bcdf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:12.966965 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7302875a-9047-43ee-800e-5968f59bcdf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:12.967499 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7302875a-9047-43ee-800e-5968f59bcdf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:12.968011 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7302875a-9047-43ee-800e-5968f59bcdf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:12.968961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7302875a-9047-43ee-800e-5968f59bcdf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:12.969657 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7302875a-9047-43ee-800e-5968f59bcdf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:12.971759 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7302875a-9047-43ee-800e-5968f59bcdf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:13.143049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-7302875a-9047-43ee-800e-5968f59bcdf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:13.160647 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-7302875a-9047-43ee-800e-5968f59bcdf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1679 microversion: 2.1 time: 0.208619 Sep 19 12:30:13.164652 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 182/369] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:12 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:13.298569 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-1e55a76f-1f57-4aa8-a17a-ab839cadd067 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:13.303102 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-1e55a76f-1f57-4aa8-a17a-ab839cadd067 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:13.309796 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1e55a76f-1f57-4aa8-a17a-ab839cadd067 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:13.310639 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1e55a76f-1f57-4aa8-a17a-ab839cadd067 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:13.311525 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1e55a76f-1f57-4aa8-a17a-ab839cadd067 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:13.312450 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1e55a76f-1f57-4aa8-a17a-ab839cadd067 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:13.313136 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1e55a76f-1f57-4aa8-a17a-ab839cadd067 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:13.314553 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1e55a76f-1f57-4aa8-a17a-ab839cadd067 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:13.360545 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-1e55a76f-1f57-4aa8-a17a-ab839cadd067 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lazy-loading 'flavor' on Instance uuid ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:30:13.365190 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:30:13.824177 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-1e55a76f-1f57-4aa8-a17a-ab839cadd067 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "POST /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/action" status: 200 len: 32 microversion: 2.1 time: 0.522611 Sep 19 12:30:13.824177 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 188/370] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Sep 19 12:30:13 2022] POST /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/action => generated 32 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 12:30:13.826269 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ff9d8958-f2a9-474c-931f-decde6f40112 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:13.826893 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ff9d8958-f2a9-474c-931f-decde6f40112 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:13.837614 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ff9d8958-f2a9-474c-931f-decde6f40112 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:13.838108 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ff9d8958-f2a9-474c-931f-decde6f40112 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:13.838757 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ff9d8958-f2a9-474c-931f-decde6f40112 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:13.839631 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ff9d8958-f2a9-474c-931f-decde6f40112 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:13.840249 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ff9d8958-f2a9-474c-931f-decde6f40112 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:13.840892 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ff9d8958-f2a9-474c-931f-decde6f40112 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:14.201236 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b341ba09-d080-4b84-a175-5f9acfaf4e6c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:14.202226 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-b341ba09-d080-4b84-a175-5f9acfaf4e6c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:14.217591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b341ba09-d080-4b84-a175-5f9acfaf4e6c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:14.218323 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b341ba09-d080-4b84-a175-5f9acfaf4e6c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:14.219069 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b341ba09-d080-4b84-a175-5f9acfaf4e6c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:14.221775 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b341ba09-d080-4b84-a175-5f9acfaf4e6c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:14.222384 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b341ba09-d080-4b84-a175-5f9acfaf4e6c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:14.222948 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b341ba09-d080-4b84-a175-5f9acfaf4e6c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:14.389455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ff9d8958-f2a9-474c-931f-decde6f40112 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:14.400297 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:30:14.419068 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ff9d8958-f2a9-474c-931f-decde6f40112 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.596392 Sep 19 12:30:14.419068 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 183/371] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:13 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:14.775855 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-b341ba09-d080-4b84-a175-5f9acfaf4e6c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:14.795554 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-b341ba09-d080-4b84-a175-5f9acfaf4e6c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1679 microversion: 2.1 time: 0.611737 Sep 19 12:30:14.796271 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 189/372] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:14 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1679 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:15.450830 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-43ac94e8-a725-4249-9eda-0197a1cc8e26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:15.452108 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-43ac94e8-a725-4249-9eda-0197a1cc8e26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:15.472834 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-43ac94e8-a725-4249-9eda-0197a1cc8e26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:15.477301 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-43ac94e8-a725-4249-9eda-0197a1cc8e26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:15.478192 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-43ac94e8-a725-4249-9eda-0197a1cc8e26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:15.479111 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-43ac94e8-a725-4249-9eda-0197a1cc8e26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:15.479733 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-43ac94e8-a725-4249-9eda-0197a1cc8e26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:15.480161 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-43ac94e8-a725-4249-9eda-0197a1cc8e26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:15.824631 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a73889dd-663d-4f04-9630-1607adc901c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:15.847469 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a73889dd-663d-4f04-9630-1607adc901c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:15.847469 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a73889dd-663d-4f04-9630-1607adc901c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:15.847469 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a73889dd-663d-4f04-9630-1607adc901c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:15.847469 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a73889dd-663d-4f04-9630-1607adc901c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:15.848249 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a73889dd-663d-4f04-9630-1607adc901c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:15.848249 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a73889dd-663d-4f04-9630-1607adc901c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:15.848249 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a73889dd-663d-4f04-9630-1607adc901c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:16.018561 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-43ac94e8-a725-4249-9eda-0197a1cc8e26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:16.027000 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-43ac94e8-a725-4249-9eda-0197a1cc8e26 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.582870 Sep 19 12:30:16.041195 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 184/373] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:15 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:16.163021 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-a73889dd-663d-4f04-9630-1607adc901c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:16.176419 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a73889dd-663d-4f04-9630-1607adc901c1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1679 microversion: 2.1 time: 0.359659 Sep 19 12:30:16.185275 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 190/374] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:15 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1679 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:16.897575 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-f556642c-6842-45fb-bd6c-9c0fa74782ce req-49993936-3293-4e80-a8fe-291f78e359b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd91105-a661-4f11-9581-7ba50b06e00f", "name": "network-vif-deleted", "tag": "89d94a1c-21ee-47bd-b318-aa47d5d6059b"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:16.910207 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-f556642c-6842-45fb-bd6c-9c0fa74782ce req-49993936-3293-4e80-a8fe-291f78e359b8 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:16.910920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-f556642c-6842-45fb-bd6c-9c0fa74782ce req-49993936-3293-4e80-a8fe-291f78e359b8 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:16.911507 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-f556642c-6842-45fb-bd6c-9c0fa74782ce req-49993936-3293-4e80-a8fe-291f78e359b8 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:16.925663 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-f556642c-6842-45fb-bd6c-9c0fa74782ce req-49993936-3293-4e80-a8fe-291f78e359b8 service nova] Creating event network-vif-deleted:89d94a1c-21ee-47bd-b318-aa47d5d6059b for instance ddd91105-a661-4f11-9581-7ba50b06e00f on hv-cinder-85061 Sep 19 12:30:16.932903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-f556642c-6842-45fb-bd6c-9c0fa74782ce req-49993936-3293-4e80-a8fe-291f78e359b8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039259 Sep 19 12:30:16.934060 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 185/375] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:30:17.068520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ab226440-0490-48a7-9b7f-36219506b9df tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:17.070493 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-ab226440-0490-48a7-9b7f-36219506b9df tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:17.079980 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ab226440-0490-48a7-9b7f-36219506b9df tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:17.081751 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ab226440-0490-48a7-9b7f-36219506b9df tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:17.082124 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ab226440-0490-48a7-9b7f-36219506b9df tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:17.082833 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ab226440-0490-48a7-9b7f-36219506b9df tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:17.083276 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ab226440-0490-48a7-9b7f-36219506b9df tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:17.083878 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ab226440-0490-48a7-9b7f-36219506b9df tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:17.210866 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-43c79c2f-def8-4fd0-bb14-686b6454d61b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:17.212376 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-43c79c2f-def8-4fd0-bb14-686b6454d61b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:17.228353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-43c79c2f-def8-4fd0-bb14-686b6454d61b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:17.228885 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-43c79c2f-def8-4fd0-bb14-686b6454d61b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:17.236187 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-43c79c2f-def8-4fd0-bb14-686b6454d61b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:17.236187 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-43c79c2f-def8-4fd0-bb14-686b6454d61b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:17.236187 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-43c79c2f-def8-4fd0-bb14-686b6454d61b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:17.238233 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-43c79c2f-def8-4fd0-bb14-686b6454d61b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:17.383748 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-ab226440-0490-48a7-9b7f-36219506b9df tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:17.400108 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ab226440-0490-48a7-9b7f-36219506b9df tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.336577 Sep 19 12:30:17.401676 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 191/376] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:17 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:17.432726 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-43c79c2f-def8-4fd0-bb14-686b6454d61b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:17.443070 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-43c79c2f-def8-4fd0-bb14-686b6454d61b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1326 microversion: 2.1 time: 0.236906 Sep 19 12:30:17.458152 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 186/377] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:17 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1326 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:30:18.426245 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-36509721-006e-4598-9e53-e7717fe721bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:18.428767 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-36509721-006e-4598-9e53-e7717fe721bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:18.443100 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-36509721-006e-4598-9e53-e7717fe721bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:18.443939 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-36509721-006e-4598-9e53-e7717fe721bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:18.444621 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-36509721-006e-4598-9e53-e7717fe721bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:18.445347 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-36509721-006e-4598-9e53-e7717fe721bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:18.446613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-36509721-006e-4598-9e53-e7717fe721bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:18.447323 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-36509721-006e-4598-9e53-e7717fe721bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:18.470515 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c0063c2d-98e3-472f-acac-ad801868602b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:18.472055 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c0063c2d-98e3-472f-acac-ad801868602b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:18.495001 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c0063c2d-98e3-472f-acac-ad801868602b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:18.495670 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c0063c2d-98e3-472f-acac-ad801868602b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:18.522564 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c0063c2d-98e3-472f-acac-ad801868602b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:18.529681 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c0063c2d-98e3-472f-acac-ad801868602b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:18.529681 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c0063c2d-98e3-472f-acac-ad801868602b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:18.529681 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c0063c2d-98e3-472f-acac-ad801868602b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:18.678605 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c0063c2d-98e3-472f-acac-ad801868602b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:18.679102 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c0063c2d-98e3-472f-acac-ad801868602b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:18.684234 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c0063c2d-98e3-472f-acac-ad801868602b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:18.685847 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.objects.instance [None req-c0063c2d-98e3-472f-acac-ad801868602b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lazy-loading 'fault' on Instance uuid ddd91105-a661-4f11-9581-7ba50b06e00f {{(pid=121429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:30:18.822996 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c0063c2d-98e3-472f-acac-ad801868602b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:18.831597 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c0063c2d-98e3-472f-acac-ad801868602b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 200 len: 1331 microversion: 2.1 time: 0.365332 Sep 19 12:30:18.838336 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 187/378] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:18 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 1331 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:18.895827 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-36509721-006e-4598-9e53-e7717fe721bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:18.913916 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-36509721-006e-4598-9e53-e7717fe721bd tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.489510 Sep 19 12:30:18.931660 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 192/379] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:18 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:19.869581 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-90227119-b489-4063-8864-8c1dbc868a5a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:19.874728 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-90227119-b489-4063-8864-8c1dbc868a5a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:19.883418 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-90227119-b489-4063-8864-8c1dbc868a5a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:19.884175 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-90227119-b489-4063-8864-8c1dbc868a5a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:19.884824 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-90227119-b489-4063-8864-8c1dbc868a5a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:19.885922 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-90227119-b489-4063-8864-8c1dbc868a5a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:19.887099 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-90227119-b489-4063-8864-8c1dbc868a5a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:19.887687 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-90227119-b489-4063-8864-8c1dbc868a5a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:19.926688 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-90227119-b489-4063-8864-8c1dbc868a5a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] HTTP exception thrown: Instance ddd91105-a661-4f11-9581-7ba50b06e00f could not be found. Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-90227119-b489-4063-8864-8c1dbc868a5a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Request method failure captured: Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f HTTP/1.1 Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKF_xba_JzZBCLNYzS-MR7i3MH3BmQnGBrtpnxxJ02XYU-aLwAMxUp37Js2oVsjZH1Xi2UqEV1PX4cz9KrfQYP2FUn0P4VJxchdxu1X2bfyWUsNGE-kHp0diwIJQq10d4xyW6w1vIK1PG2u4EnZQQclxeJyL0DgqKkwpL098U-5D5sHs Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:30:19.930911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:30:19.932433 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_68496d9aa29542139f00104051248a5b", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/68496d9aa29542139f00104051248a5b"}]}] Sep 19 12:30:19.932433 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:30:19.932433 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:30:19.932433 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:30:19.932433 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:30:19.932433 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:30:19.932433 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:30:19.932433 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 3a48e0ab477f43d294607d441af0b444 Sep 19 12:30:19.932433 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:30:19.932433 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:30:19.932433 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance ddd91105-a661-4f11-9581-7ba50b06e00f could not be found. Sep 19 12:30:19.932433 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': 'ddd91105-a661-4f11-9581-7ba50b06e00f'} Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddd91105-a661-4f11-9581-7ba50b06e00f could not be found. Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:30:19.933487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:30:19.934920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:30:19.934920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:30:19.934920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:30:19.934920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:30:19.934920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:30:19.934920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:30:19.934920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:30:19.934920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddd91105-a661-4f11-9581-7ba50b06e00f could not be found. Sep 19 12:30:19.934920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:19.934920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:30:19.934920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:19.934920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:30:19.934920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:30:19.934920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:30:19.934920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:30:19.934920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:30:19.934920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddd91105-a661-4f11-9581-7ba50b06e00f could not be found. Sep 19 12:30:19.934920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:19.936654 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-90227119-b489-4063-8864-8c1dbc868a5a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Returning 404 to user: Instance ddd91105-a661-4f11-9581-7ba50b06e00f could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:30:19.938472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-90227119-b489-4063-8864-8c1dbc868a5a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 404 len: 111 microversion: 2.1 time: 0.081009 Sep 19 12:30:19.940659 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 188/380] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:19 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:30:19.942754 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-fd29c00b-1277-4fb4-a604-e699255f9c4e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:19.944695 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-fd29c00b-1277-4fb4-a604-e699255f9c4e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:19.947889 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:30:19.962145 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fd29c00b-1277-4fb4-a604-e699255f9c4e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:19.962952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fd29c00b-1277-4fb4-a604-e699255f9c4e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:19.963164 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-01b6a2ad-9e1f-4835-bdf6-057367b6c78e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '.version_select at 0x7f54b36891f0>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:19.964136 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fd29c00b-1277-4fb4-a604-e699255f9c4e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:19.965224 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fd29c00b-1277-4fb4-a604-e699255f9c4e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:19.966006 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fd29c00b-1277-4fb4-a604-e699255f9c4e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:19.966598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fd29c00b-1277-4fb4-a604-e699255f9c4e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:20.104852 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-01b6a2ad-9e1f-4835-bdf6-057367b6c78e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199228932" status: 202 len: 0 microversion: 2.1 time: 0.151622 Sep 19 12:30:20.106102 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 189/381] 10.222.0.93 () {58 vars in 1221 bytes} [Mon Sep 19 12:30:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199228932 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:30:20.194081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-fd29c00b-1277-4fb4-a604-e699255f9c4e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:20.202886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-fd29c00b-1277-4fb4-a604-e699255f9c4e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.265170 Sep 19 12:30:20.203462 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 193/382] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:19 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:30:21.120911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-965377da-9cf8-42e2-9d6a-7a9d46e30c76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:21.122276 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-965377da-9cf8-42e2-9d6a-7a9d46e30c76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:21.129670 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-965377da-9cf8-42e2-9d6a-7a9d46e30c76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:21.130457 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-965377da-9cf8-42e2-9d6a-7a9d46e30c76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:21.131117 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-965377da-9cf8-42e2-9d6a-7a9d46e30c76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:21.131916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-965377da-9cf8-42e2-9d6a-7a9d46e30c76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:21.132532 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-965377da-9cf8-42e2-9d6a-7a9d46e30c76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:21.134659 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-965377da-9cf8-42e2-9d6a-7a9d46e30c76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:21.229144 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-2e494361-f94a-4919-ac04-e0e973f4b36a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:21.230347 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-2e494361-f94a-4919-ac04-e0e973f4b36a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:21.236492 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2e494361-f94a-4919-ac04-e0e973f4b36a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:21.236947 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2e494361-f94a-4919-ac04-e0e973f4b36a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:21.237571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2e494361-f94a-4919-ac04-e0e973f4b36a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:21.240831 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2e494361-f94a-4919-ac04-e0e973f4b36a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:21.241591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2e494361-f94a-4919-ac04-e0e973f4b36a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:21.243473 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2e494361-f94a-4919-ac04-e0e973f4b36a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:21.302138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.objects.instance [None req-965377da-9cf8-42e2-9d6a-7a9d46e30c76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lazy-loading 'services' on Instance uuid a4930060-ddb1-4835-a231-ea79ffb14068 {{(pid=121429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:30:21.419615 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2e494361-f94a-4919-ac04-e0e973f4b36a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:21.430798 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-2e494361-f94a-4919-ac04-e0e973f4b36a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.206175 Sep 19 12:30:21.432688 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 194/383] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:21 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:30:21.693055 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-965377da-9cf8-42e2-9d6a-7a9d46e30c76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068/os-volume_attachments/36194571-1d0e-4b41-a304-cb1f03f5b37b" status: 202 len: 0 microversion: 2.1 time: 0.578501 Sep 19 12:30:21.694059 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 190/384] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Sep 19 12:30:21 2022] DELETE /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068/os-volume_attachments/36194571-1d0e-4b41-a304-cb1f03f5b37b => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:30:21.705546 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c56181e6-8307-4403-8477-e780d622fb11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:21.708345 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c56181e6-8307-4403-8477-e780d622fb11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:21.715842 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c56181e6-8307-4403-8477-e780d622fb11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:21.716775 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c56181e6-8307-4403-8477-e780d622fb11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:21.717469 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c56181e6-8307-4403-8477-e780d622fb11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:21.718452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c56181e6-8307-4403-8477-e780d622fb11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:21.719127 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c56181e6-8307-4403-8477-e780d622fb11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:21.719764 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c56181e6-8307-4403-8477-e780d622fb11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:21.779311 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c56181e6-8307-4403-8477-e780d622fb11 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080018 Sep 19 12:30:21.780102 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 195/385] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Sep 19 12:30:21 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:30:22.456853 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-de6e5ba9-917e-4c01-b6e4-9b22436bcce3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:22.457501 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-de6e5ba9-917e-4c01-b6e4-9b22436bcce3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:22.459563 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:30:22.465192 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-de6e5ba9-917e-4c01-b6e4-9b22436bcce3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:22.468051 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-de6e5ba9-917e-4c01-b6e4-9b22436bcce3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:22.468051 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-de6e5ba9-917e-4c01-b6e4-9b22436bcce3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:22.468051 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-de6e5ba9-917e-4c01-b6e4-9b22436bcce3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:22.468051 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-de6e5ba9-917e-4c01-b6e4-9b22436bcce3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:22.468434 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-de6e5ba9-917e-4c01-b6e4-9b22436bcce3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:22.601329 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-de6e5ba9-917e-4c01-b6e4-9b22436bcce3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:22.609988 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-de6e5ba9-917e-4c01-b6e4-9b22436bcce3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.158113 Sep 19 12:30:22.610566 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 191/386] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:22 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:22.794819 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-83488012-a821-459a-9a09-b7f9abdc0fd1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:22.797095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-83488012-a821-459a-9a09-b7f9abdc0fd1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:22.803895 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-83488012-a821-459a-9a09-b7f9abdc0fd1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:22.804927 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-83488012-a821-459a-9a09-b7f9abdc0fd1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:22.805630 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-83488012-a821-459a-9a09-b7f9abdc0fd1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:22.806423 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-83488012-a821-459a-9a09-b7f9abdc0fd1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:22.807078 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-83488012-a821-459a-9a09-b7f9abdc0fd1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:22.807873 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-83488012-a821-459a-9a09-b7f9abdc0fd1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:22.844761 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-83488012-a821-459a-9a09-b7f9abdc0fd1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055946 Sep 19 12:30:22.850222 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 196/387] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Sep 19 12:30:22 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:30:23.634723 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2abd2793-21b9-463a-9680-2247e256a73b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:23.635343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2abd2793-21b9-463a-9680-2247e256a73b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:23.646071 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2abd2793-21b9-463a-9680-2247e256a73b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:23.646833 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2abd2793-21b9-463a-9680-2247e256a73b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:23.647587 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2abd2793-21b9-463a-9680-2247e256a73b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:23.649303 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2abd2793-21b9-463a-9680-2247e256a73b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:23.649931 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2abd2793-21b9-463a-9680-2247e256a73b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:23.650365 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2abd2793-21b9-463a-9680-2247e256a73b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:23.803119 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2abd2793-21b9-463a-9680-2247e256a73b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:23.812972 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2abd2793-21b9-463a-9680-2247e256a73b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.182902 Sep 19 12:30:23.813876 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 192/388] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:23 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:23.857711 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-dfcff3c0-e141-4899-9563-71336b0d2a02 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:23.859814 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-dfcff3c0-e141-4899-9563-71336b0d2a02 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:23.866469 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dfcff3c0-e141-4899-9563-71336b0d2a02 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:23.866951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dfcff3c0-e141-4899-9563-71336b0d2a02 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:23.868170 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dfcff3c0-e141-4899-9563-71336b0d2a02 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:23.868975 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dfcff3c0-e141-4899-9563-71336b0d2a02 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:23.869622 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dfcff3c0-e141-4899-9563-71336b0d2a02 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:23.870381 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dfcff3c0-e141-4899-9563-71336b0d2a02 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:23.902614 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-dfcff3c0-e141-4899-9563-71336b0d2a02 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048795 Sep 19 12:30:23.908884 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 197/389] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Sep 19 12:30:23 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 12:30:23.984434 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b7a5fcfc-b18d-4e61-9425-64a1594fd64d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:23.984949 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b7a5fcfc-b18d-4e61-9425-64a1594fd64d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:23.991188 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b7a5fcfc-b18d-4e61-9425-64a1594fd64d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:23.991878 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b7a5fcfc-b18d-4e61-9425-64a1594fd64d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:23.993025 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b7a5fcfc-b18d-4e61-9425-64a1594fd64d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:23.993967 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b7a5fcfc-b18d-4e61-9425-64a1594fd64d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:23.994579 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b7a5fcfc-b18d-4e61-9425-64a1594fd64d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:23.995157 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b7a5fcfc-b18d-4e61-9425-64a1594fd64d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:24.025290 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b7a5fcfc-b18d-4e61-9425-64a1594fd64d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Going to try to terminate instance {{(pid=121429) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:30:24.375248 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-b7a5fcfc-b18d-4e61-9425-64a1594fd64d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 204 len: 0 microversion: 2.1 time: 0.394365 Sep 19 12:30:24.376005 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 193/390] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:30:23 2022] DELETE /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:30:24.388087 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ffa92773-9fe9-440e-8ef6-a307eb0d6e5c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:24.388819 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-ffa92773-9fe9-440e-8ef6-a307eb0d6e5c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:24.395492 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ffa92773-9fe9-440e-8ef6-a307eb0d6e5c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:24.396206 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ffa92773-9fe9-440e-8ef6-a307eb0d6e5c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:24.396731 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ffa92773-9fe9-440e-8ef6-a307eb0d6e5c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:24.397490 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ffa92773-9fe9-440e-8ef6-a307eb0d6e5c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:24.398060 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ffa92773-9fe9-440e-8ef6-a307eb0d6e5c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:24.398660 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ffa92773-9fe9-440e-8ef6-a307eb0d6e5c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:24.555677 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-ffa92773-9fe9-440e-8ef6-a307eb0d6e5c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:24.564289 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ffa92773-9fe9-440e-8ef6-a307eb0d6e5c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1682 microversion: 2.1 time: 0.182991 Sep 19 12:30:24.577337 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 198/391] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:24 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1682 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:24.838739 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ef6c5743-3ac4-4a14-b734-b47336e467f4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:24.839559 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ef6c5743-3ac4-4a14-b734-b47336e467f4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:24.846368 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ef6c5743-3ac4-4a14-b734-b47336e467f4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:24.846862 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ef6c5743-3ac4-4a14-b734-b47336e467f4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:24.847297 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ef6c5743-3ac4-4a14-b734-b47336e467f4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:24.847991 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ef6c5743-3ac4-4a14-b734-b47336e467f4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:24.848439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ef6c5743-3ac4-4a14-b734-b47336e467f4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:24.848876 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ef6c5743-3ac4-4a14-b734-b47336e467f4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:24.992102 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ef6c5743-3ac4-4a14-b734-b47336e467f4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:25.001010 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ef6c5743-3ac4-4a14-b734-b47336e467f4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.167012 Sep 19 12:30:25.001930 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 194/392] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:24 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:25.588806 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-0cb3e378-d0c7-40d1-a023-b2f9bc42f688 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:25.590092 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-0cb3e378-d0c7-40d1-a023-b2f9bc42f688 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:25.596533 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0cb3e378-d0c7-40d1-a023-b2f9bc42f688 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:25.597052 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0cb3e378-d0c7-40d1-a023-b2f9bc42f688 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:25.597508 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0cb3e378-d0c7-40d1-a023-b2f9bc42f688 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:25.598218 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0cb3e378-d0c7-40d1-a023-b2f9bc42f688 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:25.598653 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0cb3e378-d0c7-40d1-a023-b2f9bc42f688 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:25.599066 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0cb3e378-d0c7-40d1-a023-b2f9bc42f688 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:25.734697 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-0cb3e378-d0c7-40d1-a023-b2f9bc42f688 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:25.742947 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-0cb3e378-d0c7-40d1-a023-b2f9bc42f688 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1682 microversion: 2.1 time: 0.157965 Sep 19 12:30:25.743500 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 199/393] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:25 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:26.026038 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-a6dddef2-3b3f-49f5-a50e-25a285925357 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:26.026557 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-a6dddef2-3b3f-49f5-a50e-25a285925357 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:26.032945 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a6dddef2-3b3f-49f5-a50e-25a285925357 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:26.033424 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a6dddef2-3b3f-49f5-a50e-25a285925357 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:26.033886 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a6dddef2-3b3f-49f5-a50e-25a285925357 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:26.034566 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a6dddef2-3b3f-49f5-a50e-25a285925357 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:26.035013 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a6dddef2-3b3f-49f5-a50e-25a285925357 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:26.035565 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a6dddef2-3b3f-49f5-a50e-25a285925357 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:26.199194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-a6dddef2-3b3f-49f5-a50e-25a285925357 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:26.208827 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-a6dddef2-3b3f-49f5-a50e-25a285925357 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.187244 Sep 19 12:30:26.211477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 195/394] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:26 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:26.772069 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-2dc38fc4-f8d7-4966-b07d-995bbe13682e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:26.773967 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-2dc38fc4-f8d7-4966-b07d-995bbe13682e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:26.782162 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2dc38fc4-f8d7-4966-b07d-995bbe13682e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:26.782650 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2dc38fc4-f8d7-4966-b07d-995bbe13682e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:26.783383 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2dc38fc4-f8d7-4966-b07d-995bbe13682e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:26.784089 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2dc38fc4-f8d7-4966-b07d-995bbe13682e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:26.784542 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2dc38fc4-f8d7-4966-b07d-995bbe13682e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:26.784999 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2dc38fc4-f8d7-4966-b07d-995bbe13682e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:26.955565 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2dc38fc4-f8d7-4966-b07d-995bbe13682e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:26.964431 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-2dc38fc4-f8d7-4966-b07d-995bbe13682e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1682 microversion: 2.1 time: 0.196183 Sep 19 12:30:26.965346 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 200/395] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:26 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1682 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:27.157935 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-0ae5cd91-d822-4bcb-8834-d688acd82bea tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Action: 'create', calling method: .version_select at 0x7f54b3577a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-742350595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEajIwElNY6hAWHFvyFF/UpudTe1u+PPpe3FNhJ8Le2j3juoEuouleS7MuV96Fkz9sIOyIU+XZvj6xcYVeC1hBtKUZ7RYsFRGrYbhcXXIai776STNcchIGU+NWF8cOggIA=="}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:27.175040 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-0ae5cd91-d822-4bcb-8834-d688acd82bea tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Getting quotas for project e212d8593720481abae6cfa656f03078. Resources: {'key_pairs'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:30:27.180194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-0ae5cd91-d822-4bcb-8834-d688acd82bea tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Getting quotas for user be4cbf49e37942729c183cc745da983c and project e212d8593720481abae6cfa656f03078. Resources: {'key_pairs'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:30:27.237313 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e2405f64-ca0a-4daa-974d-71925659ec5e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:27.238042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e2405f64-ca0a-4daa-974d-71925659ec5e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:27.245210 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e2405f64-ca0a-4daa-974d-71925659ec5e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:27.245821 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e2405f64-ca0a-4daa-974d-71925659ec5e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:27.246258 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e2405f64-ca0a-4daa-974d-71925659ec5e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:27.246951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e2405f64-ca0a-4daa-974d-71925659ec5e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:27.247395 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e2405f64-ca0a-4daa-974d-71925659ec5e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:27.247813 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e2405f64-ca0a-4daa-974d-71925659ec5e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:27.296532 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-0ae5cd91-d822-4bcb-8834-d688acd82bea tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.142405 Sep 19 12:30:27.297131 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 196/396] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Sep 19 12:30:27 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:30:27.349424 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-414b72c8-4ee3-4c77-9717-8125ee4711dc tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-353174787", "imageRef": "7ff216af-f583-445a-8903-bdfc8362cfbf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-742350595", "networks": [{"uuid": "50bac15b-6fa2-47bb-9dab-556f8cadd54c"}]}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:27.402932 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.network.neutron [None req-414b72c8-4ee3-4c77-9717-8125ee4711dc tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] validate_networks() for [('50bac15b-6fa2-47bb-9dab-556f8cadd54c', None, None, None, None, None)] {{(pid=121429) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:30:27.545364 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e2405f64-ca0a-4daa-974d-71925659ec5e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:27.555124 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e2405f64-ca0a-4daa-974d-71925659ec5e tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.321606 Sep 19 12:30:27.568850 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 201/397] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:27 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:30:27.792873 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-74ce5c39-c6b7-46bf-a647-d53070db3f30 req-4c82acd1-0c45-4252-bb26-b42ff90729f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4930060-ddb1-4835-a231-ea79ffb14068", "name": "network-vif-deleted", "tag": "c4e762c9-9e21-4d97-aae6-808ed7a47183"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:27.804252 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-74ce5c39-c6b7-46bf-a647-d53070db3f30 req-4c82acd1-0c45-4252-bb26-b42ff90729f0 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:27.818858 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-74ce5c39-c6b7-46bf-a647-d53070db3f30 req-4c82acd1-0c45-4252-bb26-b42ff90729f0 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:27.818858 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-74ce5c39-c6b7-46bf-a647-d53070db3f30 req-4c82acd1-0c45-4252-bb26-b42ff90729f0 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:27.818858 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-74ce5c39-c6b7-46bf-a647-d53070db3f30 req-4c82acd1-0c45-4252-bb26-b42ff90729f0 service nova] Creating event network-vif-deleted:c4e762c9-9e21-4d97-aae6-808ed7a47183 for instance a4930060-ddb1-4835-a231-ea79ffb14068 on hv-cinder-85061 Sep 19 12:30:27.823155 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-74ce5c39-c6b7-46bf-a647-d53070db3f30 req-4c82acd1-0c45-4252-bb26-b42ff90729f0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034844 Sep 19 12:30:27.824112 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 202/398] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:30:27.979886 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-414b72c8-4ee3-4c77-9717-8125ee4711dc tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Flavor limits 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:30:27.980306 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-414b72c8-4ee3-4c77-9717-8125ee4711dc tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Image limits 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:30:27.980806 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-414b72c8-4ee3-4c77-9717-8125ee4711dc tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Flavor pref 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:30:27.981577 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-414b72c8-4ee3-4c77-9717-8125ee4711dc tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Image pref 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:30:27.981999 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-414b72c8-4ee3-4c77-9717-8125ee4711dc tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:30:27.989073 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c0e37183-7f38-42a0-bd5e-e05e695f6185 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:27.989288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c0e37183-7f38-42a0-bd5e-e05e695f6185 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:27.995771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c0e37183-7f38-42a0-bd5e-e05e695f6185 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:27.996250 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c0e37183-7f38-42a0-bd5e-e05e695f6185 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:27.997220 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c0e37183-7f38-42a0-bd5e-e05e695f6185 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:27.997392 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c0e37183-7f38-42a0-bd5e-e05e695f6185 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:27.998009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c0e37183-7f38-42a0-bd5e-e05e695f6185 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:27.998430 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c0e37183-7f38-42a0-bd5e-e05e695f6185 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:27.999089 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-414b72c8-4ee3-4c77-9717-8125ee4711dc tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:27.999577 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-414b72c8-4ee3-4c77-9717-8125ee4711dc tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:28.000013 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-414b72c8-4ee3-4c77-9717-8125ee4711dc tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:28.000775 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-414b72c8-4ee3-4c77-9717-8125ee4711dc tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:28.001473 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-414b72c8-4ee3-4c77-9717-8125ee4711dc tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:28.008582 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-414b72c8-4ee3-4c77-9717-8125ee4711dc tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:28.035300 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-414b72c8-4ee3-4c77-9717-8125ee4711dc tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Getting quotas for project e212d8593720481abae6cfa656f03078. Resources: {'instances', 'ram', 'cores'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:30:28.040247 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-414b72c8-4ee3-4c77-9717-8125ee4711dc tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Getting quotas for user be4cbf49e37942729c183cc745da983c and project e212d8593720481abae6cfa656f03078. Resources: {'instances', 'ram', 'cores'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:30:28.052989 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-414b72c8-4ee3-4c77-9717-8125ee4711dc tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Going to run 1 instances... {{(pid=121429) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:30:28.055406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-414b72c8-4ee3-4c77-9717-8125ee4711dc tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ff216af-f583-445a-8903-bdfc8362cfbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121429) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:30:28.074194 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c0e37183-7f38-42a0-bd5e-e05e695f6185 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:28.083590 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c0e37183-7f38-42a0-bd5e-e05e695f6185 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1326 microversion: 2.1 time: 0.099455 Sep 19 12:30:28.084571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 203/399] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:27 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1326 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:28.191276 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-414b72c8-4ee3-4c77-9717-8125ee4711dc tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845778 Sep 19 12:30:28.191927 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 197/400] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:30:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 12:30:28.204452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-34fcde69-d432-484b-be07-206392631a04 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:28.206074 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-34fcde69-d432-484b-be07-206392631a04 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:28.270990 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-34fcde69-d432-484b-be07-206392631a04 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:28.282645 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-34fcde69-d432-484b-be07-206392631a04 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1257 microversion: 2.1 time: 0.078549 Sep 19 12:30:28.283516 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 204/401] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:28 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1257 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:28.578419 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-27631605-dd29-4e33-8f2b-1495ebe18ac6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:28.579039 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-27631605-dd29-4e33-8f2b-1495ebe18ac6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:28.585385 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-27631605-dd29-4e33-8f2b-1495ebe18ac6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:28.585874 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-27631605-dd29-4e33-8f2b-1495ebe18ac6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:28.586316 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-27631605-dd29-4e33-8f2b-1495ebe18ac6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:28.587041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-27631605-dd29-4e33-8f2b-1495ebe18ac6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:28.587494 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-27631605-dd29-4e33-8f2b-1495ebe18ac6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:28.587928 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-27631605-dd29-4e33-8f2b-1495ebe18ac6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:28.749154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-27631605-dd29-4e33-8f2b-1495ebe18ac6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:28.759647 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-27631605-dd29-4e33-8f2b-1495ebe18ac6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.185214 Sep 19 12:30:28.760794 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 198/402] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:28 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:29.108875 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-486f5ac1-54de-4068-91ff-ee34aad0d245 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:29.109623 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-486f5ac1-54de-4068-91ff-ee34aad0d245 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:29.118978 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-486f5ac1-54de-4068-91ff-ee34aad0d245 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:29.119691 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-486f5ac1-54de-4068-91ff-ee34aad0d245 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:29.121823 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-486f5ac1-54de-4068-91ff-ee34aad0d245 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:29.121823 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-486f5ac1-54de-4068-91ff-ee34aad0d245 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:29.121823 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-486f5ac1-54de-4068-91ff-ee34aad0d245 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:29.121823 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-486f5ac1-54de-4068-91ff-ee34aad0d245 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:29.131705 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:30:29.169828 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-486f5ac1-54de-4068-91ff-ee34aad0d245 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:29.170286 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-486f5ac1-54de-4068-91ff-ee34aad0d245 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:29.170965 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-486f5ac1-54de-4068-91ff-ee34aad0d245 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:29.171625 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-486f5ac1-54de-4068-91ff-ee34aad0d245 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lazy-loading 'fault' on Instance uuid a4930060-ddb1-4835-a231-ea79ffb14068 {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:30:29.224211 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-486f5ac1-54de-4068-91ff-ee34aad0d245 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:29.233860 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-486f5ac1-54de-4068-91ff-ee34aad0d245 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 200 len: 1331 microversion: 2.1 time: 0.129269 Sep 19 12:30:29.238953 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 205/403] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:29 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 1331 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:29.306239 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-734a244b-d3f3-4145-b169-0b3c3765daa7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:29.307265 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-734a244b-d3f3-4145-b169-0b3c3765daa7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:29.369281 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-734a244b-d3f3-4145-b169-0b3c3765daa7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:29.377068 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-734a244b-d3f3-4145-b169-0b3c3765daa7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1257 microversion: 2.1 time: 0.075032 Sep 19 12:30:29.377650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 199/404] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:29 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1257 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:29.783934 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-38b73f6f-b395-43b0-b476-a9d82293e56a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:29.784545 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-38b73f6f-b395-43b0-b476-a9d82293e56a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:29.791385 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-38b73f6f-b395-43b0-b476-a9d82293e56a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:29.791871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-38b73f6f-b395-43b0-b476-a9d82293e56a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:29.794358 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-38b73f6f-b395-43b0-b476-a9d82293e56a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:29.795102 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-38b73f6f-b395-43b0-b476-a9d82293e56a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:29.795562 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-38b73f6f-b395-43b0-b476-a9d82293e56a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:29.795988 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-38b73f6f-b395-43b0-b476-a9d82293e56a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:29.952874 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-38b73f6f-b395-43b0-b476-a9d82293e56a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:29.962862 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-38b73f6f-b395-43b0-b476-a9d82293e56a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.183080 Sep 19 12:30:29.964535 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 206/405] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:29 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:30.259093 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-bb8eff3d-0744-486c-a4ae-fa9c181367b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:30.259701 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-bb8eff3d-0744-486c-a4ae-fa9c181367b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:30.267066 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bb8eff3d-0744-486c-a4ae-fa9c181367b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:30.267621 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bb8eff3d-0744-486c-a4ae-fa9c181367b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:30.268226 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bb8eff3d-0744-486c-a4ae-fa9c181367b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:30.268904 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bb8eff3d-0744-486c-a4ae-fa9c181367b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:30.269504 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bb8eff3d-0744-486c-a4ae-fa9c181367b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:30.269931 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bb8eff3d-0744-486c-a4ae-fa9c181367b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:30.284694 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-bb8eff3d-0744-486c-a4ae-fa9c181367b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] HTTP exception thrown: Instance a4930060-ddb1-4835-a231-ea79ffb14068 could not be found. Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-bb8eff3d-0744-486c-a4ae-fa9c181367b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Request method failure captured: Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 HTTP/1.1 Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKF_xba_JzZBCLNYzS-MR7i3MH3BmQnGBrtpnxxJ02XYU-aLwAMxUp37Js2oVsjZH1Xi2UqEV1PX4cz9KrfQYP2FUn0P4VJxchdxu1X2bfyWUsNGE-kHp0diwIJQq10d4xyW6w1vIK1PG2u4EnZQQclxeJyL0DgqKkwpL098U-5D5sHs Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:30:30.289482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:30:30.291083 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_68496d9aa29542139f00104051248a5b", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/68496d9aa29542139f00104051248a5b"}]}] Sep 19 12:30:30.291083 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:30:30.291083 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:30:30.291083 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:30:30.291083 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:30:30.291083 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:30:30.291083 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:30:30.291083 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 3a48e0ab477f43d294607d441af0b444 Sep 19 12:30:30.291083 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:30:30.291083 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:30:30.291083 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance a4930060-ddb1-4835-a231-ea79ffb14068 could not be found. Sep 19 12:30:30.291083 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': 'a4930060-ddb1-4835-a231-ea79ffb14068'} Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4930060-ddb1-4835-a231-ea79ffb14068 could not be found. Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:30:30.291953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:30:30.293383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:30:30.293383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:30:30.293383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:30:30.293383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:30:30.293383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:30:30.293383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:30:30.293383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:30:30.293383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4930060-ddb1-4835-a231-ea79ffb14068 could not be found. Sep 19 12:30:30.293383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:30.293383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:30:30.293383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:30.293383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:30:30.293383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:30:30.293383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:30:30.293383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:30:30.293383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:30:30.293383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4930060-ddb1-4835-a231-ea79ffb14068 could not be found. Sep 19 12:30:30.293383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:30.294648 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-bb8eff3d-0744-486c-a4ae-fa9c181367b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Returning 404 to user: Instance a4930060-ddb1-4835-a231-ea79ffb14068 could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:30:30.294648 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-bb8eff3d-0744-486c-a4ae-fa9c181367b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 404 len: 111 microversion: 2.1 time: 0.033366 Sep 19 12:30:30.294648 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 200/406] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:30 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:30:30.297792 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-63dc20a4-1c2e-46b5-9ef9-f05168523118 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '.version_select at 0x7f54b361daf0>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:30.401652 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-d3730c6d-a9c2-43ed-8213-8c71725542da tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:30.402220 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-d3730c6d-a9c2-43ed-8213-8c71725542da tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:30.409677 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-63dc20a4-1c2e-46b5-9ef9-f05168523118 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-322976130" status: 202 len: 0 microversion: 2.1 time: 0.112018 Sep 19 12:30:30.409677 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 207/407] 10.222.0.93 () {58 vars in 1218 bytes} [Mon Sep 19 12:30:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-322976130 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:30:30.410126 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3730c6d-a9c2-43ed-8213-8c71725542da tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:30.410251 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3730c6d-a9c2-43ed-8213-8c71725542da tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:30.410604 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3730c6d-a9c2-43ed-8213-8c71725542da tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:30.411327 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3730c6d-a9c2-43ed-8213-8c71725542da tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:30.411775 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3730c6d-a9c2-43ed-8213-8c71725542da tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:30.412195 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3730c6d-a9c2-43ed-8213-8c71725542da tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:30.486811 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-d3730c6d-a9c2-43ed-8213-8c71725542da tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:30.499688 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-d3730c6d-a9c2-43ed-8213-8c71725542da tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1253 microversion: 2.1 time: 0.102482 Sep 19 12:30:30.501249 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 201/408] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:30 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1253 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:30.987921 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-bd9616da-ed1c-42d5-8936-fe2a5712187f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:30.988569 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-bd9616da-ed1c-42d5-8936-fe2a5712187f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:30.996710 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bd9616da-ed1c-42d5-8936-fe2a5712187f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:30.997439 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bd9616da-ed1c-42d5-8936-fe2a5712187f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:30.998256 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bd9616da-ed1c-42d5-8936-fe2a5712187f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:30.999008 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bd9616da-ed1c-42d5-8936-fe2a5712187f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:30.999607 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bd9616da-ed1c-42d5-8936-fe2a5712187f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:31.000175 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bd9616da-ed1c-42d5-8936-fe2a5712187f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:31.182066 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-bd9616da-ed1c-42d5-8936-fe2a5712187f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:31.192679 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-bd9616da-ed1c-42d5-8936-fe2a5712187f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.209063 Sep 19 12:30:31.193709 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 208/409] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:30 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:31.449710 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-36c04f86-48a8-4129-a921-a66ec883bc45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Action: 'create', calling method: .version_select at 0x7f54b35779d0>, body: {"keypair": {"name": "tempest-keypair-1942085181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3bBtjzYWU5y5dZjcFg5L/4BPnNVIyRlRnqJbTD/ctidSlFmORwpKU06lHWjd22kDMGAxG3ehjaQ8KUg0WaNdae2eUTyZjoV5iiX/qs32PyD02PKtJjMwu3V9miSdX/wA=="}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:31.478235 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-36c04f86-48a8-4129-a921-a66ec883bc45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Getting quotas for project 68496d9aa29542139f00104051248a5b. Resources: {'key_pairs'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:30:31.483078 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-36c04f86-48a8-4129-a921-a66ec883bc45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Getting quotas for user 3a48e0ab477f43d294607d441af0b444 and project 68496d9aa29542139f00104051248a5b. Resources: {'key_pairs'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:30:31.528343 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ae139883-3661-42be-9bff-38841d18b208 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:31.530369 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-ae139883-3661-42be-9bff-38841d18b208 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:31.538156 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ae139883-3661-42be-9bff-38841d18b208 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:31.539429 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ae139883-3661-42be-9bff-38841d18b208 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:31.539619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ae139883-3661-42be-9bff-38841d18b208 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:31.540329 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ae139883-3661-42be-9bff-38841d18b208 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:31.540992 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ae139883-3661-42be-9bff-38841d18b208 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:31.541583 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ae139883-3661-42be-9bff-38841d18b208 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:31.587269 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-36c04f86-48a8-4129-a921-a66ec883bc45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.142823 Sep 19 12:30:31.588257 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 202/410] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Sep 19 12:30:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:30:31.627529 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-ae139883-3661-42be-9bff-38841d18b208 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:31.637669 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ae139883-3661-42be-9bff-38841d18b208 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1317 microversion: 2.1 time: 0.115884 Sep 19 12:30:31.651710 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 209/411] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:31 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1317 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:30:32.218230 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-8d6c593a-5488-4d65-b645-858556bd6931 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:32.218230 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-8d6c593a-5488-4d65-b645-858556bd6931 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:32.225848 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8d6c593a-5488-4d65-b645-858556bd6931 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:32.227519 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8d6c593a-5488-4d65-b645-858556bd6931 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:32.228208 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8d6c593a-5488-4d65-b645-858556bd6931 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:32.229501 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8d6c593a-5488-4d65-b645-858556bd6931 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:32.229713 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8d6c593a-5488-4d65-b645-858556bd6931 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:32.230318 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8d6c593a-5488-4d65-b645-858556bd6931 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:32.376766 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8d6c593a-5488-4d65-b645-858556bd6931 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:32.386578 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-8d6c593a-5488-4d65-b645-858556bd6931 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.172368 Sep 19 12:30:32.387186 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 203/412] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:32 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:30:32.662346 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-3d929713-b118-47d2-9d29-f2a526e1eacf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:32.663247 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-3d929713-b118-47d2-9d29-f2a526e1eacf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:32.671752 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3d929713-b118-47d2-9d29-f2a526e1eacf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:32.672975 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3d929713-b118-47d2-9d29-f2a526e1eacf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:32.673794 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3d929713-b118-47d2-9d29-f2a526e1eacf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:32.674754 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3d929713-b118-47d2-9d29-f2a526e1eacf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:32.675415 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3d929713-b118-47d2-9d29-f2a526e1eacf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:32.676014 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3d929713-b118-47d2-9d29-f2a526e1eacf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:32.779101 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-3d929713-b118-47d2-9d29-f2a526e1eacf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:32.790414 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-3d929713-b118-47d2-9d29-f2a526e1eacf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1327 microversion: 2.1 time: 0.133103 Sep 19 12:30:32.791483 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 210/413] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:32 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1327 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:33.411213 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e62e19d0-915a-4516-9634-67bf43f2ea3f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:33.411933 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-e62e19d0-915a-4516-9634-67bf43f2ea3f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:33.423122 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e62e19d0-915a-4516-9634-67bf43f2ea3f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:33.424688 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e62e19d0-915a-4516-9634-67bf43f2ea3f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:33.428487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e62e19d0-915a-4516-9634-67bf43f2ea3f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:33.428487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e62e19d0-915a-4516-9634-67bf43f2ea3f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:33.429132 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e62e19d0-915a-4516-9634-67bf43f2ea3f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:33.431122 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e62e19d0-915a-4516-9634-67bf43f2ea3f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:33.457257 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:30:33.739504 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e62e19d0-915a-4516-9634-67bf43f2ea3f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:33.762197 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e62e19d0-915a-4516-9634-67bf43f2ea3f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.355143 Sep 19 12:30:33.766315 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 204/414] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:33 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:33.817474 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-65c9607a-6301-4f34-a133-74d7296078f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:33.818724 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-65c9607a-6301-4f34-a133-74d7296078f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:33.833796 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65c9607a-6301-4f34-a133-74d7296078f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:33.834390 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65c9607a-6301-4f34-a133-74d7296078f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:33.840467 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65c9607a-6301-4f34-a133-74d7296078f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:33.841599 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65c9607a-6301-4f34-a133-74d7296078f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:33.842397 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65c9607a-6301-4f34-a133-74d7296078f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:33.845246 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65c9607a-6301-4f34-a133-74d7296078f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:34.109024 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-65c9607a-6301-4f34-a133-74d7296078f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:34.118361 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-65c9607a-6301-4f34-a133-74d7296078f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1357 microversion: 2.1 time: 0.305932 Sep 19 12:30:34.119716 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 211/415] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:33 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1357 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:34.795162 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-aea56ecf-3d8d-4fe9-8398-fb9a8d117f76 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:34.796355 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-aea56ecf-3d8d-4fe9-8398-fb9a8d117f76 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:34.822103 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aea56ecf-3d8d-4fe9-8398-fb9a8d117f76 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:34.822103 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aea56ecf-3d8d-4fe9-8398-fb9a8d117f76 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:34.822710 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aea56ecf-3d8d-4fe9-8398-fb9a8d117f76 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:34.823669 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aea56ecf-3d8d-4fe9-8398-fb9a8d117f76 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:34.825393 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aea56ecf-3d8d-4fe9-8398-fb9a8d117f76 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:34.826109 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aea56ecf-3d8d-4fe9-8398-fb9a8d117f76 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:35.036713 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-9736f2c6-2a3a-4d3d-80a8-44f08bf439fc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2000500991", "imageRef": "d4301833-8e96-46bf-a940-692f93f7fdba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2775bc2c-1de6-4530-99c8-74593487735c"}], "security_groups": [{"name": "tempest-securitygroup--1122942167"}], "key_name": "tempest-keypair-1942085181", "user_data": "}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:35.114806 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-aea56ecf-3d8d-4fe9-8398-fb9a8d117f76 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:35.131240 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-aea56ecf-3d8d-4fe9-8398-fb9a8d117f76 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.344858 Sep 19 12:30:35.149307 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 205/416] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:34 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:35.152634 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-7a229b99-bdc6-491c-8eaf-df64983d169c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:35.153522 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-7a229b99-bdc6-491c-8eaf-df64983d169c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:35.163334 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7a229b99-bdc6-491c-8eaf-df64983d169c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:35.165108 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7a229b99-bdc6-491c-8eaf-df64983d169c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:35.165549 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7a229b99-bdc6-491c-8eaf-df64983d169c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:35.166269 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7a229b99-bdc6-491c-8eaf-df64983d169c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:35.166723 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7a229b99-bdc6-491c-8eaf-df64983d169c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:35.167148 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7a229b99-bdc6-491c-8eaf-df64983d169c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:35.236893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.network.neutron [None req-9736f2c6-2a3a-4d3d-80a8-44f08bf439fc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] validate_networks() for [('2775bc2c-1de6-4530-99c8-74593487735c', None, None, None, None, None)] {{(pid=121428) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:30:35.543079 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-7a229b99-bdc6-491c-8eaf-df64983d169c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:35.555164 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-7a229b99-bdc6-491c-8eaf-df64983d169c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1357 microversion: 2.1 time: 0.406315 Sep 19 12:30:35.559669 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 206/417] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:35 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1357 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:35.920413 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-9736f2c6-2a3a-4d3d-80a8-44f08bf439fc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Flavor limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:30:35.921862 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-9736f2c6-2a3a-4d3d-80a8-44f08bf439fc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Image limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:30:35.922347 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-9736f2c6-2a3a-4d3d-80a8-44f08bf439fc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Flavor pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:30:35.922758 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-9736f2c6-2a3a-4d3d-80a8-44f08bf439fc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Image pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:30:35.923170 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-9736f2c6-2a3a-4d3d-80a8-44f08bf439fc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:30:35.934380 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9736f2c6-2a3a-4d3d-80a8-44f08bf439fc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:35.935045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9736f2c6-2a3a-4d3d-80a8-44f08bf439fc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:35.935659 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9736f2c6-2a3a-4d3d-80a8-44f08bf439fc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:35.936872 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9736f2c6-2a3a-4d3d-80a8-44f08bf439fc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:35.938968 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9736f2c6-2a3a-4d3d-80a8-44f08bf439fc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:35.939420 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9736f2c6-2a3a-4d3d-80a8-44f08bf439fc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:35.958871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-9736f2c6-2a3a-4d3d-80a8-44f08bf439fc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Getting quotas for project 68496d9aa29542139f00104051248a5b. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:30:35.967404 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-9736f2c6-2a3a-4d3d-80a8-44f08bf439fc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Getting quotas for user 3a48e0ab477f43d294607d441af0b444 and project 68496d9aa29542139f00104051248a5b. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:30:35.981702 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-9736f2c6-2a3a-4d3d-80a8-44f08bf439fc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Going to run 1 instances... {{(pid=121428) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:30:35.984434 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-9736f2c6-2a3a-4d3d-80a8-44f08bf439fc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4301833-8e96-46bf-a940-692f93f7fdba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:30:36.133500 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-9736f2c6-2a3a-4d3d-80a8-44f08bf439fc tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.097716 Sep 19 12:30:36.133500 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 212/418] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:30:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:30:36.144191 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-d730a120-40fd-4ab4-a23f-b7e0152c6fb9 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:36.145972 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-d730a120-40fd-4ab4-a23f-b7e0152c6fb9 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:36.158692 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f8721b35-a0fa-4997-ab1c-adb066b0ec8f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:36.159769 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f8721b35-a0fa-4997-ab1c-adb066b0ec8f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:36.188526 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f8721b35-a0fa-4997-ab1c-adb066b0ec8f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:36.193585 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f8721b35-a0fa-4997-ab1c-adb066b0ec8f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:36.194136 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f8721b35-a0fa-4997-ab1c-adb066b0ec8f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:36.195506 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f8721b35-a0fa-4997-ab1c-adb066b0ec8f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:36.196007 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f8721b35-a0fa-4997-ab1c-adb066b0ec8f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:36.196439 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f8721b35-a0fa-4997-ab1c-adb066b0ec8f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:36.264809 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-d730a120-40fd-4ab4-a23f-b7e0152c6fb9 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:36.281276 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-d730a120-40fd-4ab4-a23f-b7e0152c6fb9 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1242 microversion: 2.1 time: 0.142135 Sep 19 12:30:36.300336 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 207/419] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:36 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1242 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:36.489281 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f8721b35-a0fa-4997-ab1c-adb066b0ec8f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:36.508671 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f8721b35-a0fa-4997-ab1c-adb066b0ec8f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.353546 Sep 19 12:30:36.511077 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 213/420] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:36 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:30:36.580575 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-8fd483ba-4ce5-4d7a-9fb1-d5b3724be630 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:36.581570 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-8fd483ba-4ce5-4d7a-9fb1-d5b3724be630 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:36.598011 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8fd483ba-4ce5-4d7a-9fb1-d5b3724be630 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:36.637123 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8fd483ba-4ce5-4d7a-9fb1-d5b3724be630 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:36.637123 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8fd483ba-4ce5-4d7a-9fb1-d5b3724be630 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:36.637123 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8fd483ba-4ce5-4d7a-9fb1-d5b3724be630 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:36.637123 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8fd483ba-4ce5-4d7a-9fb1-d5b3724be630 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:36.637630 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8fd483ba-4ce5-4d7a-9fb1-d5b3724be630 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:36.817672 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8fd483ba-4ce5-4d7a-9fb1-d5b3724be630 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:36.840924 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-8fd483ba-4ce5-4d7a-9fb1-d5b3724be630 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1357 microversion: 2.1 time: 0.264994 Sep 19 12:30:36.844748 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 208/421] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:36 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1357 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:30:37.315899 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-5d18998d-cd6f-4a00-9425-bd46f3c11f79 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:37.318020 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-5d18998d-cd6f-4a00-9425-bd46f3c11f79 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:37.399933 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5d18998d-cd6f-4a00-9425-bd46f3c11f79 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:37.417101 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-5d18998d-cd6f-4a00-9425-bd46f3c11f79 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1242 microversion: 2.1 time: 0.108914 Sep 19 12:30:37.420800 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 214/422] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:37 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1242 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:37.540054 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-fa903366-a96a-470d-870c-94aca77f3105 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:37.541271 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-fa903366-a96a-470d-870c-94aca77f3105 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:37.558576 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fa903366-a96a-470d-870c-94aca77f3105 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:37.563407 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fa903366-a96a-470d-870c-94aca77f3105 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:37.563407 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fa903366-a96a-470d-870c-94aca77f3105 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:37.563407 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fa903366-a96a-470d-870c-94aca77f3105 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:37.567117 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fa903366-a96a-470d-870c-94aca77f3105 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:37.567658 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fa903366-a96a-470d-870c-94aca77f3105 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:37.787100 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-fa903366-a96a-470d-870c-94aca77f3105 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:37.797034 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-fa903366-a96a-470d-870c-94aca77f3105 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.264881 Sep 19 12:30:37.800919 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 209/423] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:37 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:37.864029 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-7ede414f-1d16-4d45-926b-e00c666eeb6b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:37.865099 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-7ede414f-1d16-4d45-926b-e00c666eeb6b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:37.877200 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7ede414f-1d16-4d45-926b-e00c666eeb6b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:37.877601 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7ede414f-1d16-4d45-926b-e00c666eeb6b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:37.878055 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7ede414f-1d16-4d45-926b-e00c666eeb6b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:37.878820 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7ede414f-1d16-4d45-926b-e00c666eeb6b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:37.879289 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7ede414f-1d16-4d45-926b-e00c666eeb6b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:37.879723 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7ede414f-1d16-4d45-926b-e00c666eeb6b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:38.082348 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-7ede414f-1d16-4d45-926b-e00c666eeb6b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:38.094871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-7ede414f-1d16-4d45-926b-e00c666eeb6b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1357 microversion: 2.1 time: 0.235051 Sep 19 12:30:38.097622 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 215/424] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:37 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:38.446302 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-701295f0-ebac-4ee7-b015-8a895d90a205 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:38.447190 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-701295f0-ebac-4ee7-b015-8a895d90a205 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:38.449230 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=2 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:30:38.455696 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-701295f0-ebac-4ee7-b015-8a895d90a205 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:38.461579 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-701295f0-ebac-4ee7-b015-8a895d90a205 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:38.461579 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-701295f0-ebac-4ee7-b015-8a895d90a205 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:38.461579 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-701295f0-ebac-4ee7-b015-8a895d90a205 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:38.461579 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-701295f0-ebac-4ee7-b015-8a895d90a205 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:38.462088 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-701295f0-ebac-4ee7-b015-8a895d90a205 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:38.531245 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-701295f0-ebac-4ee7-b015-8a895d90a205 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:38.540155 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-701295f0-ebac-4ee7-b015-8a895d90a205 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1246 microversion: 2.1 time: 0.101353 Sep 19 12:30:38.556473 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 210/425] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:38 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1246 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:38.825683 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-715dc233-3175-4d15-afc9-b4be5a961c22 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:38.826493 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-715dc233-3175-4d15-afc9-b4be5a961c22 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:38.839734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-715dc233-3175-4d15-afc9-b4be5a961c22 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:38.841720 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-715dc233-3175-4d15-afc9-b4be5a961c22 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:38.842941 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-715dc233-3175-4d15-afc9-b4be5a961c22 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:38.845362 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-715dc233-3175-4d15-afc9-b4be5a961c22 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:38.846028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-715dc233-3175-4d15-afc9-b4be5a961c22 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:38.846989 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-715dc233-3175-4d15-afc9-b4be5a961c22 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:39.024275 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-715dc233-3175-4d15-afc9-b4be5a961c22 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:39.058002 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-715dc233-3175-4d15-afc9-b4be5a961c22 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.225874 Sep 19 12:30:39.058002 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 216/426] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:38 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:39.117275 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c29e40c7-e80a-4584-837a-bc17e5d60bf2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:39.117888 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c29e40c7-e80a-4584-837a-bc17e5d60bf2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:39.125817 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c29e40c7-e80a-4584-837a-bc17e5d60bf2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:39.126303 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c29e40c7-e80a-4584-837a-bc17e5d60bf2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:39.126747 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c29e40c7-e80a-4584-837a-bc17e5d60bf2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:39.127443 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c29e40c7-e80a-4584-837a-bc17e5d60bf2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:39.127889 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c29e40c7-e80a-4584-837a-bc17e5d60bf2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:39.128308 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c29e40c7-e80a-4584-837a-bc17e5d60bf2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:39.425034 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c29e40c7-e80a-4584-837a-bc17e5d60bf2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:39.425034 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c29e40c7-e80a-4584-837a-bc17e5d60bf2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1357 microversion: 2.1 time: 0.263467 Sep 19 12:30:39.425034 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 211/427] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:39 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1357 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:39.565279 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d3e2ce34-10cf-4bcc-89a1-b56dfdbe7c8f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:39.566614 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d3e2ce34-10cf-4bcc-89a1-b56dfdbe7c8f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:39.577188 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3e2ce34-10cf-4bcc-89a1-b56dfdbe7c8f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:39.578733 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3e2ce34-10cf-4bcc-89a1-b56dfdbe7c8f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:39.579313 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3e2ce34-10cf-4bcc-89a1-b56dfdbe7c8f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:39.580290 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3e2ce34-10cf-4bcc-89a1-b56dfdbe7c8f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:39.580928 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3e2ce34-10cf-4bcc-89a1-b56dfdbe7c8f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:39.581477 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3e2ce34-10cf-4bcc-89a1-b56dfdbe7c8f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:39.671840 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-d3e2ce34-10cf-4bcc-89a1-b56dfdbe7c8f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:39.689043 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d3e2ce34-10cf-4bcc-89a1-b56dfdbe7c8f tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1246 microversion: 2.1 time: 0.121516 Sep 19 12:30:39.692692 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 217/428] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:39 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1246 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:40.074725 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-14e635b7-daae-425e-8716-fc74dbe382e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:40.076312 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-14e635b7-daae-425e-8716-fc74dbe382e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:40.093483 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-14e635b7-daae-425e-8716-fc74dbe382e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:40.094393 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-14e635b7-daae-425e-8716-fc74dbe382e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:40.095045 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-14e635b7-daae-425e-8716-fc74dbe382e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:40.095974 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-14e635b7-daae-425e-8716-fc74dbe382e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:40.096504 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-14e635b7-daae-425e-8716-fc74dbe382e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:40.096954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-14e635b7-daae-425e-8716-fc74dbe382e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:40.298840 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-14e635b7-daae-425e-8716-fc74dbe382e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:40.308452 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-14e635b7-daae-425e-8716-fc74dbe382e0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.238020 Sep 19 12:30:40.309642 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 212/429] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:40 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:40.449165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b56a3a32-73a1-4169-b916-8a8ea84d2fd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:40.449866 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-b56a3a32-73a1-4169-b916-8a8ea84d2fd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:40.456754 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b56a3a32-73a1-4169-b916-8a8ea84d2fd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:40.457165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b56a3a32-73a1-4169-b916-8a8ea84d2fd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:40.457709 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b56a3a32-73a1-4169-b916-8a8ea84d2fd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:40.458511 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b56a3a32-73a1-4169-b916-8a8ea84d2fd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:40.459053 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b56a3a32-73a1-4169-b916-8a8ea84d2fd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:40.459503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b56a3a32-73a1-4169-b916-8a8ea84d2fd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:40.610894 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-b56a3a32-73a1-4169-b916-8a8ea84d2fd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:40.619468 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-b56a3a32-73a1-4169-b916-8a8ea84d2fd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1357 microversion: 2.1 time: 0.174750 Sep 19 12:30:40.620060 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 218/430] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:40 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:40.715433 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-412c2071-ede5-48a1-a16f-13f0ecb45eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:40.716039 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-412c2071-ede5-48a1-a16f-13f0ecb45eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:40.723474 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-412c2071-ede5-48a1-a16f-13f0ecb45eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:40.723976 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-412c2071-ede5-48a1-a16f-13f0ecb45eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:40.724413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-412c2071-ede5-48a1-a16f-13f0ecb45eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:40.725157 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-412c2071-ede5-48a1-a16f-13f0ecb45eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:40.725612 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-412c2071-ede5-48a1-a16f-13f0ecb45eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:40.726556 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-412c2071-ede5-48a1-a16f-13f0ecb45eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:40.797896 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-412c2071-ede5-48a1-a16f-13f0ecb45eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:40.807648 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-412c2071-ede5-48a1-a16f-13f0ecb45eb7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1246 microversion: 2.1 time: 0.096472 Sep 19 12:30:40.808239 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 213/431] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:40 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:41.335945 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8594bbde-caf0-4dc4-9def-2698fac3da09 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:41.336622 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-8594bbde-caf0-4dc4-9def-2698fac3da09 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:41.343322 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8594bbde-caf0-4dc4-9def-2698fac3da09 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:41.343634 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8594bbde-caf0-4dc4-9def-2698fac3da09 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:41.344281 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8594bbde-caf0-4dc4-9def-2698fac3da09 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:41.344991 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8594bbde-caf0-4dc4-9def-2698fac3da09 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:41.345543 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8594bbde-caf0-4dc4-9def-2698fac3da09 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:41.346063 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8594bbde-caf0-4dc4-9def-2698fac3da09 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:41.492573 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-8594bbde-caf0-4dc4-9def-2698fac3da09 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:41.501355 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8594bbde-caf0-4dc4-9def-2698fac3da09 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1731 microversion: 2.1 time: 0.172067 Sep 19 12:30:41.501952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 219/432] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:41 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:41.642881 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3c82e158-d11d-4f25-be0e-cd8c2ee7a2c9 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:41.644074 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3c82e158-d11d-4f25-be0e-cd8c2ee7a2c9 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:41.653503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3c82e158-d11d-4f25-be0e-cd8c2ee7a2c9 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:41.654004 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3c82e158-d11d-4f25-be0e-cd8c2ee7a2c9 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:41.654442 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3c82e158-d11d-4f25-be0e-cd8c2ee7a2c9 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:41.655235 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3c82e158-d11d-4f25-be0e-cd8c2ee7a2c9 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:41.655709 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3c82e158-d11d-4f25-be0e-cd8c2ee7a2c9 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:41.656129 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3c82e158-d11d-4f25-be0e-cd8c2ee7a2c9 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:41.808791 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3c82e158-d11d-4f25-be0e-cd8c2ee7a2c9 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:41.818590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3c82e158-d11d-4f25-be0e-cd8c2ee7a2c9 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1357 microversion: 2.1 time: 0.179677 Sep 19 12:30:41.819171 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 214/433] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:41 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:41.830477 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-2c89b671-dc19-4bff-8d92-bada790a8f37 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:41.831094 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-2c89b671-dc19-4bff-8d92-bada790a8f37 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:41.837520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2c89b671-dc19-4bff-8d92-bada790a8f37 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:41.842746 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2c89b671-dc19-4bff-8d92-bada790a8f37 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:41.842746 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2c89b671-dc19-4bff-8d92-bada790a8f37 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:41.842746 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2c89b671-dc19-4bff-8d92-bada790a8f37 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:41.842746 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2c89b671-dc19-4bff-8d92-bada790a8f37 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:41.843157 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2c89b671-dc19-4bff-8d92-bada790a8f37 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:41.916398 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2c89b671-dc19-4bff-8d92-bada790a8f37 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:41.925142 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-2c89b671-dc19-4bff-8d92-bada790a8f37 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1246 microversion: 2.1 time: 0.098766 Sep 19 12:30:41.925729 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 220/434] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:41 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:42.526642 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-30eb411a-771f-4d39-bb24-d64da8843a5a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:42.527163 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-30eb411a-771f-4d39-bb24-d64da8843a5a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:42.533940 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-30eb411a-771f-4d39-bb24-d64da8843a5a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:42.534539 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-30eb411a-771f-4d39-bb24-d64da8843a5a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:42.534989 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-30eb411a-771f-4d39-bb24-d64da8843a5a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:42.535852 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-30eb411a-771f-4d39-bb24-d64da8843a5a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:42.536344 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-30eb411a-771f-4d39-bb24-d64da8843a5a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:42.536812 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-30eb411a-771f-4d39-bb24-d64da8843a5a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:42.742795 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-30eb411a-771f-4d39-bb24-d64da8843a5a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:42.751275 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-30eb411a-771f-4d39-bb24-d64da8843a5a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1711 microversion: 2.1 time: 0.229243 Sep 19 12:30:42.751857 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 215/435] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:42 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1711 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:42.842735 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-22043430-7d47-4fcf-8e83-68730b915a54 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:42.844057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-22043430-7d47-4fcf-8e83-68730b915a54 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:42.855099 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-22043430-7d47-4fcf-8e83-68730b915a54 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:42.855582 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-22043430-7d47-4fcf-8e83-68730b915a54 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:42.856017 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-22043430-7d47-4fcf-8e83-68730b915a54 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:42.856748 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-22043430-7d47-4fcf-8e83-68730b915a54 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:42.857408 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-22043430-7d47-4fcf-8e83-68730b915a54 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:42.857831 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-22043430-7d47-4fcf-8e83-68730b915a54 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:42.889887 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-04f1534a-f346-4b13-8088-b1f9ab1620cb tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:42.898779 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-04f1534a-f346-4b13-8088-b1f9ab1620cb tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:42.898779 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-04f1534a-f346-4b13-8088-b1f9ab1620cb tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:42.898779 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-04f1534a-f346-4b13-8088-b1f9ab1620cb tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:42.899157 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-04f1534a-f346-4b13-8088-b1f9ab1620cb tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:42.899664 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-04f1534a-f346-4b13-8088-b1f9ab1620cb tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:42.900121 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-04f1534a-f346-4b13-8088-b1f9ab1620cb tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:42.900654 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-04f1534a-f346-4b13-8088-b1f9ab1620cb tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:43.005309 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-04f1534a-f346-4b13-8088-b1f9ab1620cb tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] HTTP exception thrown: Cannot 'detach_volume' instance ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 while it is in vm_state rescued Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-04f1534a-f346-4b13-8088-b1f9ab1620cb tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Request method failure captured: Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: DELETE /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/os-volume_attachments/b2184f08-7c84-48ac-9dc6-bfdb1169ab22 HTTP/1.1 Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKF_tWWphb1JAPvN-EIEQSK52IRz3n-JW79g8MyFMBDW4gW63g8tf-8d7IlXyjaWL-wltQwHjjhVXyF95eo-sDcZPzinRtVOt-jy7eoPO5RoogsMqWYA2aauMqxMNdK7rALFC559OD52R_2prEh0aku1gmbjxDr3u7abPo2C0r5Yj86w Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: b4cb72be6f7d411fbfd037aebc273cb2 Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1257684246 Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:30:43.006854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:30:43.008818 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4cb72be6f7d411fbfd037aebc273cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b4cb72be6f7d411fbfd037aebc273cb2", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4cb72be6f7d411fbfd037aebc273cb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b4cb72be6f7d411fbfd037aebc273cb2"}]}] Sep 19 12:30:43.008818 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1257684246 Sep 19 12:30:43.008818 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: b4cb72be6f7d411fbfd037aebc273cb2 Sep 19 12:30:43.008818 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1257684246 Sep 19 12:30:43.008818 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-ServerRescueNegativeTestJSON-1257684246-project Sep 19 12:30:43.008818 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:30:43.008818 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:30:43.008818 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 90ec87808ac641329bc1491d1b5473d9 Sep 19 12:30:43.008818 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1257684246-project Sep 19 12:30:43.008818 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:30:43.008818 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Cannot 'detach_volume' instance ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 while it is in vm_state rescued Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'server_id': 'ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5', 'id': 'b2184f08-7c84-48ac-9dc6-bfdb1169ab22'} Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:30:43.009540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:30:43.011047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 19 12:30:43.011047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 12:30:43.011047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 12:30:43.011047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 12:30:43.011047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 while it is in vm_state rescued Sep 19 12:30:43.011047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:43.011047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:30:43.011047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:43.011047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:30:43.011047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:30:43.011047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:30:43.011047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:30:43.011047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:30:43.011047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 while it is in vm_state rescued Sep 19 12:30:43.011047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:30:43.011047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-04f1534a-f346-4b13-8088-b1f9ab1620cb tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Returning 409 to user: Cannot 'detach_volume' instance ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 while it is in vm_state rescued {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:30:43.012837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-04f1534a-f346-4b13-8088-b1f9ab1620cb tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/os-volume_attachments/b2184f08-7c84-48ac-9dc6-bfdb1169ab22" status: 409 len: 152 microversion: 2.1 time: 0.123848 Sep 19 12:30:43.014193 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 216/436] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Sep 19 12:30:42 2022] DELETE /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/os-volume_attachments/b2184f08-7c84-48ac-9dc6-bfdb1169ab22 => generated 152 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 12:30:43.021105 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-42565dfa-09ae-483c-8c60-e8ed6b4fd7b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:43.021799 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-42565dfa-09ae-483c-8c60-e8ed6b4fd7b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:43.029404 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-42565dfa-09ae-483c-8c60-e8ed6b4fd7b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:43.029788 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-42565dfa-09ae-483c-8c60-e8ed6b4fd7b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:43.030429 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-42565dfa-09ae-483c-8c60-e8ed6b4fd7b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:43.031146 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-42565dfa-09ae-483c-8c60-e8ed6b4fd7b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:43.031620 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-42565dfa-09ae-483c-8c60-e8ed6b4fd7b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:43.032314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-42565dfa-09ae-483c-8c60-e8ed6b4fd7b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:43.129276 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-42565dfa-09ae-483c-8c60-e8ed6b4fd7b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:43.141877 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-42565dfa-09ae-483c-8c60-e8ed6b4fd7b4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1238 microversion: 2.1 time: 0.125794 Sep 19 12:30:43.144708 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 217/437] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:43 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1238 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:43.148526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-08f60274-6665-4d03-a134-8ab404dd2a6a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:43.149113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-08f60274-6665-4d03-a134-8ab404dd2a6a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:43.151006 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:30:43.156546 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-08f60274-6665-4d03-a134-8ab404dd2a6a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:43.157116 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-08f60274-6665-4d03-a134-8ab404dd2a6a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:43.157559 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-08f60274-6665-4d03-a134-8ab404dd2a6a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:43.158292 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-08f60274-6665-4d03-a134-8ab404dd2a6a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:43.158749 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-08f60274-6665-4d03-a134-8ab404dd2a6a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:43.159176 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-08f60274-6665-4d03-a134-8ab404dd2a6a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:43.161545 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-22043430-7d47-4fcf-8e83-68730b915a54 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:43.172617 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-22043430-7d47-4fcf-8e83-68730b915a54 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1357 microversion: 2.1 time: 0.334203 Sep 19 12:30:43.173268 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 221/438] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:42 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1357 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:43.435783 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-171c898c-a667-4727-8d5f-4e894b552cff req-0f4572fc-0b41-45d2-a270-a8ddfe694977 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "006954cd-d599-4bb6-b64e-3fd4d87f8a87", "tag": "83af7231-e989-47cd-984e-6d5a0ed98d98"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:43.440723 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-08f60274-6665-4d03-a134-8ab404dd2a6a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "POST /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.291752 Sep 19 12:30:43.440723 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 218/439] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Sep 19 12:30:43 2022] POST /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:30:43.449121 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-fc1d0a73-dbff-4d0b-80cb-f78d7f5834bc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:43.449676 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-fc1d0a73-dbff-4d0b-80cb-f78d7f5834bc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:43.450080 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-171c898c-a667-4727-8d5f-4e894b552cff req-0f4572fc-0b41-45d2-a270-a8ddfe694977 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:43.450775 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-171c898c-a667-4727-8d5f-4e894b552cff req-0f4572fc-0b41-45d2-a270-a8ddfe694977 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:43.451386 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-171c898c-a667-4727-8d5f-4e894b552cff req-0f4572fc-0b41-45d2-a270-a8ddfe694977 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:43.459050 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc1d0a73-dbff-4d0b-80cb-f78d7f5834bc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:43.459391 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc1d0a73-dbff-4d0b-80cb-f78d7f5834bc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:43.459830 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc1d0a73-dbff-4d0b-80cb-f78d7f5834bc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:43.460546 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc1d0a73-dbff-4d0b-80cb-f78d7f5834bc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:43.461118 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc1d0a73-dbff-4d0b-80cb-f78d7f5834bc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:43.461550 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc1d0a73-dbff-4d0b-80cb-f78d7f5834bc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:43.465714 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-171c898c-a667-4727-8d5f-4e894b552cff req-0f4572fc-0b41-45d2-a270-a8ddfe694977 service nova] Creating event network-changed:83af7231-e989-47cd-984e-6d5a0ed98d98 for instance 006954cd-d599-4bb6-b64e-3fd4d87f8a87 on hv-cinder-85061 Sep 19 12:30:43.471780 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-171c898c-a667-4727-8d5f-4e894b552cff req-0f4572fc-0b41-45d2-a270-a8ddfe694977 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043349 Sep 19 12:30:43.473359 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 222/440] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:30:43.958303 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-fc1d0a73-dbff-4d0b-80cb-f78d7f5834bc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:43.967740 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-fc1d0a73-dbff-4d0b-80cb-f78d7f5834bc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1719 microversion: 2.1 time: 0.525017 Sep 19 12:30:43.968328 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 219/441] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:43 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1719 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:44.171406 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-2695988e-9df2-4430-aeb9-d98fb39aef21 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:44.172208 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-2695988e-9df2-4430-aeb9-d98fb39aef21 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:44.179243 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2695988e-9df2-4430-aeb9-d98fb39aef21 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:44.179822 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2695988e-9df2-4430-aeb9-d98fb39aef21 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:44.180333 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2695988e-9df2-4430-aeb9-d98fb39aef21 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:44.181177 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2695988e-9df2-4430-aeb9-d98fb39aef21 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:44.181694 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2695988e-9df2-4430-aeb9-d98fb39aef21 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:44.182212 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2695988e-9df2-4430-aeb9-d98fb39aef21 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:44.196925 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-21310f95-379b-47f8-84e4-b95359ce044b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:44.201791 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-21310f95-379b-47f8-84e4-b95359ce044b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:44.204958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-21310f95-379b-47f8-84e4-b95359ce044b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:44.205718 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-21310f95-379b-47f8-84e4-b95359ce044b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:44.206770 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-21310f95-379b-47f8-84e4-b95359ce044b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:44.207484 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-21310f95-379b-47f8-84e4-b95359ce044b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:44.207938 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-21310f95-379b-47f8-84e4-b95359ce044b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:44.208367 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-21310f95-379b-47f8-84e4-b95359ce044b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:44.297190 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2695988e-9df2-4430-aeb9-d98fb39aef21 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:44.306639 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-2695988e-9df2-4430-aeb9-d98fb39aef21 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1302 microversion: 2.1 time: 0.139517 Sep 19 12:30:44.307684 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 223/442] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:44 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1302 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:44.603046 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-21310f95-379b-47f8-84e4-b95359ce044b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:44.610957 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-21310f95-379b-47f8-84e4-b95359ce044b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1357 microversion: 2.1 time: 0.417860 Sep 19 12:30:44.611567 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 220/443] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:44 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1357 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:30:44.991724 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-471d50eb-38bf-4dc3-acd0-532ce270d17b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:44.992317 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-471d50eb-38bf-4dc3-acd0-532ce270d17b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:44.998366 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-471d50eb-38bf-4dc3-acd0-532ce270d17b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:44.998852 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-471d50eb-38bf-4dc3-acd0-532ce270d17b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:44.999282 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-471d50eb-38bf-4dc3-acd0-532ce270d17b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:44.999997 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-471d50eb-38bf-4dc3-acd0-532ce270d17b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:45.000903 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-471d50eb-38bf-4dc3-acd0-532ce270d17b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:45.000903 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-471d50eb-38bf-4dc3-acd0-532ce270d17b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:45.339266 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-861dac53-8c93-48ef-a5d8-2a46b137e6c0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:45.339881 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-861dac53-8c93-48ef-a5d8-2a46b137e6c0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:45.341660 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-471d50eb-38bf-4dc3-acd0-532ce270d17b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:45.347093 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-861dac53-8c93-48ef-a5d8-2a46b137e6c0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:45.347766 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-861dac53-8c93-48ef-a5d8-2a46b137e6c0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:45.348212 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-861dac53-8c93-48ef-a5d8-2a46b137e6c0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:45.349292 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=100 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:30:45.349979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-861dac53-8c93-48ef-a5d8-2a46b137e6c0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:45.351559 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-861dac53-8c93-48ef-a5d8-2a46b137e6c0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:45.352187 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-861dac53-8c93-48ef-a5d8-2a46b137e6c0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:45.356936 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:30:45.359040 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-471d50eb-38bf-4dc3-acd0-532ce270d17b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1719 microversion: 2.1 time: 0.371299 Sep 19 12:30:45.359662 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 224/444] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:44 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1719 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:45.435999 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-861dac53-8c93-48ef-a5d8-2a46b137e6c0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:45.444358 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-861dac53-8c93-48ef-a5d8-2a46b137e6c0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1300 microversion: 2.1 time: 0.109449 Sep 19 12:30:45.444962 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 221/445] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:45 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:30:45.639607 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8ab46a3a-9af3-4132-95ee-0c9580fe5546 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:45.640220 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-8ab46a3a-9af3-4132-95ee-0c9580fe5546 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:45.646297 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8ab46a3a-9af3-4132-95ee-0c9580fe5546 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:45.646779 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8ab46a3a-9af3-4132-95ee-0c9580fe5546 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:45.647216 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8ab46a3a-9af3-4132-95ee-0c9580fe5546 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:45.648441 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8ab46a3a-9af3-4132-95ee-0c9580fe5546 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:45.648922 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8ab46a3a-9af3-4132-95ee-0c9580fe5546 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:45.649347 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8ab46a3a-9af3-4132-95ee-0c9580fe5546 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:45.825164 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-8ab46a3a-9af3-4132-95ee-0c9580fe5546 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:45.829603 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8ab46a3a-9af3-4132-95ee-0c9580fe5546 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1357 microversion: 2.1 time: 0.194604 Sep 19 12:30:45.830285 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 225/446] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:45 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1357 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:46.381525 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=18 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:30:46.386706 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4517638d-5390-44fb-99fd-f31ec5f4f3a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:46.387455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4517638d-5390-44fb-99fd-f31ec5f4f3a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:46.394058 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4517638d-5390-44fb-99fd-f31ec5f4f3a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:46.394537 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4517638d-5390-44fb-99fd-f31ec5f4f3a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:46.394972 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4517638d-5390-44fb-99fd-f31ec5f4f3a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:46.395725 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4517638d-5390-44fb-99fd-f31ec5f4f3a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:46.396253 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4517638d-5390-44fb-99fd-f31ec5f4f3a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:46.396717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4517638d-5390-44fb-99fd-f31ec5f4f3a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:46.471562 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-17d384e4-02f5-4470-b309-104a994809c6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:46.472732 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-17d384e4-02f5-4470-b309-104a994809c6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:46.476619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=2 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:30:46.484126 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-17d384e4-02f5-4470-b309-104a994809c6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:46.484692 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-17d384e4-02f5-4470-b309-104a994809c6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:46.485574 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-17d384e4-02f5-4470-b309-104a994809c6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:46.485821 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-17d384e4-02f5-4470-b309-104a994809c6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:46.486273 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-17d384e4-02f5-4470-b309-104a994809c6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:46.486694 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-17d384e4-02f5-4470-b309-104a994809c6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:46.632953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-4517638d-5390-44fb-99fd-f31ec5f4f3a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:46.639929 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4517638d-5390-44fb-99fd-f31ec5f4f3a3 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1719 microversion: 2.1 time: 0.259665 Sep 19 12:30:46.640499 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 222/447] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:46 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1719 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:46.752693 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-17d384e4-02f5-4470-b309-104a994809c6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:46.760897 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-17d384e4-02f5-4470-b309-104a994809c6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1368 microversion: 2.1 time: 0.296507 Sep 19 12:30:46.761737 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 226/448] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:46 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1368 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:46.853659 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-0bcff59b-9aad-408f-b762-76b048bf99a6 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:46.854402 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-0bcff59b-9aad-408f-b762-76b048bf99a6 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:46.860486 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0bcff59b-9aad-408f-b762-76b048bf99a6 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:46.860989 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0bcff59b-9aad-408f-b762-76b048bf99a6 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:46.861416 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0bcff59b-9aad-408f-b762-76b048bf99a6 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:46.862108 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0bcff59b-9aad-408f-b762-76b048bf99a6 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:46.862551 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0bcff59b-9aad-408f-b762-76b048bf99a6 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:46.862965 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0bcff59b-9aad-408f-b762-76b048bf99a6 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:47.015707 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-0bcff59b-9aad-408f-b762-76b048bf99a6 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:47.023353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-0bcff59b-9aad-408f-b762-76b048bf99a6 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1357 microversion: 2.1 time: 0.173664 Sep 19 12:30:47.026368 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 223/449] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:46 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:47.374835 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-f8cd7d93-44ff-4c0f-b99d-f0cfd311d5ed req-6a613efe-c33c-47e1-876e-56df6c5731b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50dff3e8-23ae-4501-b36a-35a1b3629b13", "tag": "5979e202-897a-4341-9c8c-f0e2c941d24d"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:47.384340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-f8cd7d93-44ff-4c0f-b99d-f0cfd311d5ed req-6a613efe-c33c-47e1-876e-56df6c5731b3 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:47.385042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-f8cd7d93-44ff-4c0f-b99d-f0cfd311d5ed req-6a613efe-c33c-47e1-876e-56df6c5731b3 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:47.385504 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-f8cd7d93-44ff-4c0f-b99d-f0cfd311d5ed req-6a613efe-c33c-47e1-876e-56df6c5731b3 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:47.397104 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-f8cd7d93-44ff-4c0f-b99d-f0cfd311d5ed req-6a613efe-c33c-47e1-876e-56df6c5731b3 service nova] Creating event network-changed:5979e202-897a-4341-9c8c-f0e2c941d24d for instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 on hv-cinder-85061 Sep 19 12:30:47.402085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-f8cd7d93-44ff-4c0f-b99d-f0cfd311d5ed req-6a613efe-c33c-47e1-876e-56df6c5731b3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031158 Sep 19 12:30:47.402671 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 227/450] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:30:47.663263 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9f9b4bbd-5781-47e4-b1cf-182bf4dd5e1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:47.664439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9f9b4bbd-5781-47e4-b1cf-182bf4dd5e1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:47.670443 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9f9b4bbd-5781-47e4-b1cf-182bf4dd5e1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:47.672525 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9f9b4bbd-5781-47e4-b1cf-182bf4dd5e1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:47.672525 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9f9b4bbd-5781-47e4-b1cf-182bf4dd5e1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:47.672525 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9f9b4bbd-5781-47e4-b1cf-182bf4dd5e1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:47.672525 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9f9b4bbd-5781-47e4-b1cf-182bf4dd5e1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:47.672963 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9f9b4bbd-5781-47e4-b1cf-182bf4dd5e1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:47.782712 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=10 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:30:47.787398 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-3e2065ad-d315-4e12-bf9d-555def2fca5d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:47.788150 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-3e2065ad-d315-4e12-bf9d-555def2fca5d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:47.794639 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3e2065ad-d315-4e12-bf9d-555def2fca5d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:47.795261 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3e2065ad-d315-4e12-bf9d-555def2fca5d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:47.795684 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3e2065ad-d315-4e12-bf9d-555def2fca5d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:47.796370 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3e2065ad-d315-4e12-bf9d-555def2fca5d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:47.796839 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3e2065ad-d315-4e12-bf9d-555def2fca5d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:47.797255 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3e2065ad-d315-4e12-bf9d-555def2fca5d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:47.808382 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9f9b4bbd-5781-47e4-b1cf-182bf4dd5e1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:47.816764 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9f9b4bbd-5781-47e4-b1cf-182bf4dd5e1c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1719 microversion: 2.1 time: 0.157289 Sep 19 12:30:47.817332 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 224/451] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:47 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:47.926875 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-3e2065ad-d315-4e12-bf9d-555def2fca5d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:47.934423 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-3e2065ad-d315-4e12-bf9d-555def2fca5d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1368 microversion: 2.1 time: 0.152658 Sep 19 12:30:47.934977 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 228/452] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:47 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:48.045381 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-07ec02b3-aab8-42e5-a19b-4d19930f8baf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:48.045993 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-07ec02b3-aab8-42e5-a19b-4d19930f8baf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:48.052560 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-07ec02b3-aab8-42e5-a19b-4d19930f8baf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:48.053074 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-07ec02b3-aab8-42e5-a19b-4d19930f8baf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:48.053508 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-07ec02b3-aab8-42e5-a19b-4d19930f8baf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:48.054216 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-07ec02b3-aab8-42e5-a19b-4d19930f8baf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:48.054666 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-07ec02b3-aab8-42e5-a19b-4d19930f8baf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:48.055084 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-07ec02b3-aab8-42e5-a19b-4d19930f8baf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:48.526281 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-07ec02b3-aab8-42e5-a19b-4d19930f8baf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:48.534485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-07ec02b3-aab8-42e5-a19b-4d19930f8baf tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1357 microversion: 2.1 time: 0.492950 Sep 19 12:30:48.535056 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 225/453] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:48 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1357 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:48.839859 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-818dc18e-4db8-4074-9fb7-35a042d9dbf2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:48.840498 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-818dc18e-4db8-4074-9fb7-35a042d9dbf2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:48.847053 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-818dc18e-4db8-4074-9fb7-35a042d9dbf2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:48.847532 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-818dc18e-4db8-4074-9fb7-35a042d9dbf2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:48.847960 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-818dc18e-4db8-4074-9fb7-35a042d9dbf2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:48.848678 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-818dc18e-4db8-4074-9fb7-35a042d9dbf2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:48.849132 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-818dc18e-4db8-4074-9fb7-35a042d9dbf2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:48.849553 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-818dc18e-4db8-4074-9fb7-35a042d9dbf2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:48.957130 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-35010a79-2348-4f4a-bec5-000cb4370ff5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:48.957685 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-35010a79-2348-4f4a-bec5-000cb4370ff5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:48.963448 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-35010a79-2348-4f4a-bec5-000cb4370ff5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:48.963935 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-35010a79-2348-4f4a-bec5-000cb4370ff5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:48.964363 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-35010a79-2348-4f4a-bec5-000cb4370ff5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:48.965113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-35010a79-2348-4f4a-bec5-000cb4370ff5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:48.965555 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-35010a79-2348-4f4a-bec5-000cb4370ff5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:48.965959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-35010a79-2348-4f4a-bec5-000cb4370ff5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:49.089655 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-818dc18e-4db8-4074-9fb7-35a042d9dbf2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:49.097856 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-818dc18e-4db8-4074-9fb7-35a042d9dbf2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1725 microversion: 2.1 time: 0.261777 Sep 19 12:30:49.098430 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 229/454] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:48 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1725 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:30:49.121898 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d755bcc2-16ae-40e3-9f20-624c3c6bfcb9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:49.122394 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d755bcc2-16ae-40e3-9f20-624c3c6bfcb9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:49.128559 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d755bcc2-16ae-40e3-9f20-624c3c6bfcb9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:49.129340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d755bcc2-16ae-40e3-9f20-624c3c6bfcb9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:49.129508 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d755bcc2-16ae-40e3-9f20-624c3c6bfcb9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:49.130276 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d755bcc2-16ae-40e3-9f20-624c3c6bfcb9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:49.130689 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d755bcc2-16ae-40e3-9f20-624c3c6bfcb9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:49.131531 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d755bcc2-16ae-40e3-9f20-624c3c6bfcb9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:49.136756 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-35010a79-2348-4f4a-bec5-000cb4370ff5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:49.144837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-35010a79-2348-4f4a-bec5-000cb4370ff5 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1368 microversion: 2.1 time: 0.191631 Sep 19 12:30:49.145417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 226/455] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:48 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:30:49.217760 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d755bcc2-16ae-40e3-9f20-624c3c6bfcb9 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099733 Sep 19 12:30:49.218383 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 230/456] 10.222.0.93 () {58 vars in 1275 bytes} [Mon Sep 19 12:30:49 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:30:49.557042 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-f93e93f9-138f-4d8f-be34-514dcceb54c4 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:49.557672 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-f93e93f9-138f-4d8f-be34-514dcceb54c4 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:49.563580 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f93e93f9-138f-4d8f-be34-514dcceb54c4 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:49.564059 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f93e93f9-138f-4d8f-be34-514dcceb54c4 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:49.564515 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f93e93f9-138f-4d8f-be34-514dcceb54c4 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:49.565209 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f93e93f9-138f-4d8f-be34-514dcceb54c4 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:49.569925 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f93e93f9-138f-4d8f-be34-514dcceb54c4 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:49.569925 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f93e93f9-138f-4d8f-be34-514dcceb54c4 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:49.806248 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-f93e93f9-138f-4d8f-be34-514dcceb54c4 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:49.814045 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-f93e93f9-138f-4d8f-be34-514dcceb54c4 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1357 microversion: 2.1 time: 0.260840 Sep 19 12:30:49.815017 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 227/457] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:49 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1357 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:50.167178 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-53f83ee0-c9b4-47e5-b1ee-055fc81cf9f6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:50.169119 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-53f83ee0-c9b4-47e5-b1ee-055fc81cf9f6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:50.170484 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:30:50.175151 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-53f83ee0-c9b4-47e5-b1ee-055fc81cf9f6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:50.175633 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-53f83ee0-c9b4-47e5-b1ee-055fc81cf9f6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:50.176175 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-53f83ee0-c9b4-47e5-b1ee-055fc81cf9f6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:50.179970 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-53f83ee0-c9b4-47e5-b1ee-055fc81cf9f6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:50.179970 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-53f83ee0-c9b4-47e5-b1ee-055fc81cf9f6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:50.179970 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-53f83ee0-c9b4-47e5-b1ee-055fc81cf9f6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:50.338187 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-3ee72045-06a5-49cf-8654-ad8640109bb6 req-4f33e45e-f52c-4746-9008-4eebd53ce7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5", "tag": "e85fffd8-bc70-45a1-bd7d-55d41cea22d2"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:50.352968 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-3ee72045-06a5-49cf-8654-ad8640109bb6 req-4f33e45e-f52c-4746-9008-4eebd53ce7f9 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:50.357764 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-3ee72045-06a5-49cf-8654-ad8640109bb6 req-4f33e45e-f52c-4746-9008-4eebd53ce7f9 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:50.357764 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-3ee72045-06a5-49cf-8654-ad8640109bb6 req-4f33e45e-f52c-4746-9008-4eebd53ce7f9 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:50.368555 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-3ee72045-06a5-49cf-8654-ad8640109bb6 req-4f33e45e-f52c-4746-9008-4eebd53ce7f9 service nova] Creating event network-changed:e85fffd8-bc70-45a1-bd7d-55d41cea22d2 for instance ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 on hv-cinder-85061 Sep 19 12:30:50.374311 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-3ee72045-06a5-49cf-8654-ad8640109bb6 req-4f33e45e-f52c-4746-9008-4eebd53ce7f9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040453 Sep 19 12:30:50.375309 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 228/458] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:30:50.380154 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-53f83ee0-c9b4-47e5-b1ee-055fc81cf9f6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:50.391638 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-53f83ee0-c9b4-47e5-b1ee-055fc81cf9f6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1368 microversion: 2.1 time: 0.228757 Sep 19 12:30:50.392442 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 231/459] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:50 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:50.838015 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c34684e8-59c0-4ad9-8775-a74de97e4a0f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:50.838713 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c34684e8-59c0-4ad9-8775-a74de97e4a0f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:50.844941 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c34684e8-59c0-4ad9-8775-a74de97e4a0f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:50.845426 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c34684e8-59c0-4ad9-8775-a74de97e4a0f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:50.845857 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c34684e8-59c0-4ad9-8775-a74de97e4a0f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:50.846668 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c34684e8-59c0-4ad9-8775-a74de97e4a0f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:50.847115 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c34684e8-59c0-4ad9-8775-a74de97e4a0f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:50.847533 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c34684e8-59c0-4ad9-8775-a74de97e4a0f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:51.013457 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c34684e8-59c0-4ad9-8775-a74de97e4a0f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:51.021554 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c34684e8-59c0-4ad9-8775-a74de97e4a0f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1357 microversion: 2.1 time: 0.187919 Sep 19 12:30:51.032823 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 229/460] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:50 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:51.088530 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a9cecba5-800d-4a57-ba20-181bd904be88 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:51.090853 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a9cecba5-800d-4a57-ba20-181bd904be88 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:51.097223 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9cecba5-800d-4a57-ba20-181bd904be88 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:51.097847 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9cecba5-800d-4a57-ba20-181bd904be88 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:51.098284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9cecba5-800d-4a57-ba20-181bd904be88 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:51.098983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9cecba5-800d-4a57-ba20-181bd904be88 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:51.099439 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9cecba5-800d-4a57-ba20-181bd904be88 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:51.099871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9cecba5-800d-4a57-ba20-181bd904be88 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:51.130369 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a9cecba5-800d-4a57-ba20-181bd904be88 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045878 Sep 19 12:30:51.130957 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 232/461] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Sep 19 12:30:51 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 12:30:51.198019 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-87f1242d-fde1-44ed-b11d-391d97cbbe15 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:51.198543 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-87f1242d-fde1-44ed-b11d-391d97cbbe15 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:51.206586 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-87f1242d-fde1-44ed-b11d-391d97cbbe15 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:51.206586 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-87f1242d-fde1-44ed-b11d-391d97cbbe15 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:51.206586 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-87f1242d-fde1-44ed-b11d-391d97cbbe15 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:51.206586 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-87f1242d-fde1-44ed-b11d-391d97cbbe15 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:51.207227 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-87f1242d-fde1-44ed-b11d-391d97cbbe15 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:51.207227 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-87f1242d-fde1-44ed-b11d-391d97cbbe15 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:51.232583 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-87f1242d-fde1-44ed-b11d-391d97cbbe15 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Going to try to terminate instance {{(pid=121429) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:30:51.415942 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-7d364b9c-9262-4cf4-9a4b-2ac993b3ab25 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:51.416557 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-7d364b9c-9262-4cf4-9a4b-2ac993b3ab25 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:51.423078 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7d364b9c-9262-4cf4-9a4b-2ac993b3ab25 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:51.423560 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7d364b9c-9262-4cf4-9a4b-2ac993b3ab25 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:51.424002 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7d364b9c-9262-4cf4-9a4b-2ac993b3ab25 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:51.424725 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7d364b9c-9262-4cf4-9a4b-2ac993b3ab25 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:51.425181 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7d364b9c-9262-4cf4-9a4b-2ac993b3ab25 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:51.425606 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7d364b9c-9262-4cf4-9a4b-2ac993b3ab25 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:51.551638 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-87f1242d-fde1-44ed-b11d-391d97cbbe15 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 204 len: 0 microversion: 2.1 time: 0.357343 Sep 19 12:30:51.552415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 230/462] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:30:51 2022] DELETE /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:30:51.561168 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-7d364b9c-9262-4cf4-9a4b-2ac993b3ab25 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:51.561352 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-1268ce35-b424-462b-8adb-32326a620243 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:51.562779 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-1268ce35-b424-462b-8adb-32326a620243 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:51.569240 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-7d364b9c-9262-4cf4-9a4b-2ac993b3ab25 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1368 microversion: 2.1 time: 0.157447 Sep 19 12:30:51.569423 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1268ce35-b424-462b-8adb-32326a620243 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:51.569829 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 233/463] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:51 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:30:51.570010 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1268ce35-b424-462b-8adb-32326a620243 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:51.570428 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1268ce35-b424-462b-8adb-32326a620243 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:51.571167 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1268ce35-b424-462b-8adb-32326a620243 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:51.571814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1268ce35-b424-462b-8adb-32326a620243 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:51.572274 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1268ce35-b424-462b-8adb-32326a620243 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:51.701058 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-1268ce35-b424-462b-8adb-32326a620243 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:51.708921 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-1268ce35-b424-462b-8adb-32326a620243 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1672 microversion: 2.1 time: 0.151867 Sep 19 12:30:51.709495 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 231/464] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:51 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:30:52.013409 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-df5bc3d0-e200-4c26-b6b8-816589cea161 req-e1df70b4-1c94-44d5-9df2-bd2c51301d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006954cd-d599-4bb6-b64e-3fd4d87f8a87", "name": "network-vif-plugged", "status": "completed", "tag": "83af7231-e989-47cd-984e-6d5a0ed98d98"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:52.025504 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-df5bc3d0-e200-4c26-b6b8-816589cea161 req-e1df70b4-1c94-44d5-9df2-bd2c51301d88 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:52.025988 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-df5bc3d0-e200-4c26-b6b8-816589cea161 req-e1df70b4-1c94-44d5-9df2-bd2c51301d88 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:52.026413 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-df5bc3d0-e200-4c26-b6b8-816589cea161 req-e1df70b4-1c94-44d5-9df2-bd2c51301d88 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:52.037696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-df5bc3d0-e200-4c26-b6b8-816589cea161 req-e1df70b4-1c94-44d5-9df2-bd2c51301d88 service nova] Creating event network-vif-plugged:83af7231-e989-47cd-984e-6d5a0ed98d98 for instance 006954cd-d599-4bb6-b64e-3fd4d87f8a87 on hv-cinder-85061 Sep 19 12:30:52.043482 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-df5bc3d0-e200-4c26-b6b8-816589cea161 req-e1df70b4-1c94-44d5-9df2-bd2c51301d88 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033871 Sep 19 12:30:52.044365 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 234/465] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:30:52.047846 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-31aee934-ffd1-4853-b43e-e3b60bbde44b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:52.049024 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-31aee934-ffd1-4853-b43e-e3b60bbde44b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:52.056315 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-31aee934-ffd1-4853-b43e-e3b60bbde44b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:52.063851 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-31aee934-ffd1-4853-b43e-e3b60bbde44b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:52.063851 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-31aee934-ffd1-4853-b43e-e3b60bbde44b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:52.063851 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-31aee934-ffd1-4853-b43e-e3b60bbde44b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:52.063851 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-31aee934-ffd1-4853-b43e-e3b60bbde44b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:52.064254 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-31aee934-ffd1-4853-b43e-e3b60bbde44b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:52.200780 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-31aee934-ffd1-4853-b43e-e3b60bbde44b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:52.209257 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-31aee934-ffd1-4853-b43e-e3b60bbde44b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1357 microversion: 2.1 time: 0.165835 Sep 19 12:30:52.210593 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 232/466] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:52 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:52.396047 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-712b0013-8651-400a-bba4-2f4a1674d525 req-631255f8-e13f-42dd-ab2d-563c80a92817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5", "tag": "e85fffd8-bc70-45a1-bd7d-55d41cea22d2"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:52.406210 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-712b0013-8651-400a-bba4-2f4a1674d525 req-631255f8-e13f-42dd-ab2d-563c80a92817 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:52.406679 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-712b0013-8651-400a-bba4-2f4a1674d525 req-631255f8-e13f-42dd-ab2d-563c80a92817 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:52.407106 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-712b0013-8651-400a-bba4-2f4a1674d525 req-631255f8-e13f-42dd-ab2d-563c80a92817 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:52.418744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-712b0013-8651-400a-bba4-2f4a1674d525 req-631255f8-e13f-42dd-ab2d-563c80a92817 service nova] Creating event network-changed:e85fffd8-bc70-45a1-bd7d-55d41cea22d2 for instance ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 on hv-cinder-85061 Sep 19 12:30:52.423581 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-712b0013-8651-400a-bba4-2f4a1674d525 req-631255f8-e13f-42dd-ab2d-563c80a92817 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031688 Sep 19 12:30:52.424173 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 235/467] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:30:52.592184 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5d6afc40-de65-42f7-8f12-bba881d4102a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:52.592913 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-5d6afc40-de65-42f7-8f12-bba881d4102a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:52.599344 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5d6afc40-de65-42f7-8f12-bba881d4102a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:52.599820 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5d6afc40-de65-42f7-8f12-bba881d4102a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:52.600247 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5d6afc40-de65-42f7-8f12-bba881d4102a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:52.600961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5d6afc40-de65-42f7-8f12-bba881d4102a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:52.601406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5d6afc40-de65-42f7-8f12-bba881d4102a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:52.601822 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5d6afc40-de65-42f7-8f12-bba881d4102a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:52.731648 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-5d6afc40-de65-42f7-8f12-bba881d4102a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:52.732741 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e7f29f19-d68d-4618-b54e-9cbc5bb06a96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:52.733443 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e7f29f19-d68d-4618-b54e-9cbc5bb06a96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:52.739406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5d6afc40-de65-42f7-8f12-bba881d4102a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1368 microversion: 2.1 time: 0.151075 Sep 19 12:30:52.739646 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e7f29f19-d68d-4618-b54e-9cbc5bb06a96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:52.740012 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 233/468] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:52 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:52.740337 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e7f29f19-d68d-4618-b54e-9cbc5bb06a96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:52.740450 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e7f29f19-d68d-4618-b54e-9cbc5bb06a96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:52.741203 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e7f29f19-d68d-4618-b54e-9cbc5bb06a96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:52.741660 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e7f29f19-d68d-4618-b54e-9cbc5bb06a96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:52.742085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e7f29f19-d68d-4618-b54e-9cbc5bb06a96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:52.873647 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e7f29f19-d68d-4618-b54e-9cbc5bb06a96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:52.881385 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e7f29f19-d68d-4618-b54e-9cbc5bb06a96 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1672 microversion: 2.1 time: 0.152831 Sep 19 12:30:52.887370 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 236/469] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:52 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:30:53.232843 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ddd3eef0-4bd7-4b1b-9fef-57f5eb99fb5f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:53.233455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ddd3eef0-4bd7-4b1b-9fef-57f5eb99fb5f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:53.239477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ddd3eef0-4bd7-4b1b-9fef-57f5eb99fb5f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:53.239954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ddd3eef0-4bd7-4b1b-9fef-57f5eb99fb5f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:53.240379 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ddd3eef0-4bd7-4b1b-9fef-57f5eb99fb5f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:53.241596 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ddd3eef0-4bd7-4b1b-9fef-57f5eb99fb5f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:53.242049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ddd3eef0-4bd7-4b1b-9fef-57f5eb99fb5f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:53.242467 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ddd3eef0-4bd7-4b1b-9fef-57f5eb99fb5f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:53.372909 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ddd3eef0-4bd7-4b1b-9fef-57f5eb99fb5f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:53.380776 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ddd3eef0-4bd7-4b1b-9fef-57f5eb99fb5f tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1357 microversion: 2.1 time: 0.151744 Sep 19 12:30:53.381240 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 234/470] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:53 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:53.762954 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8e2d70b9-ad1a-41c3-bb20-727cc329ec76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:53.763578 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-8e2d70b9-ad1a-41c3-bb20-727cc329ec76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:53.770873 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8e2d70b9-ad1a-41c3-bb20-727cc329ec76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:53.771559 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8e2d70b9-ad1a-41c3-bb20-727cc329ec76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:53.772896 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8e2d70b9-ad1a-41c3-bb20-727cc329ec76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:53.773907 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8e2d70b9-ad1a-41c3-bb20-727cc329ec76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:53.774114 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8e2d70b9-ad1a-41c3-bb20-727cc329ec76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:53.774504 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8e2d70b9-ad1a-41c3-bb20-727cc329ec76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:53.911686 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b8c971a6-9a3b-4578-8679-270b67368296 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:53.912902 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b8c971a6-9a3b-4578-8679-270b67368296 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:53.920230 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b8c971a6-9a3b-4578-8679-270b67368296 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:53.920838 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b8c971a6-9a3b-4578-8679-270b67368296 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:53.921278 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b8c971a6-9a3b-4578-8679-270b67368296 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:53.922193 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b8c971a6-9a3b-4578-8679-270b67368296 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:53.922755 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b8c971a6-9a3b-4578-8679-270b67368296 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:53.923472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b8c971a6-9a3b-4578-8679-270b67368296 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:54.264180 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-8e2d70b9-ad1a-41c3-bb20-727cc329ec76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:54.271972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8e2d70b9-ad1a-41c3-bb20-727cc329ec76 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1368 microversion: 2.1 time: 0.513556 Sep 19 12:30:54.273199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 237/471] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:53 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1368 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:54.282712 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-efc40dc2-fa7b-446d-aad3-bfc5738f96cf req-21cdd9b2-ab7c-4ec2-ab0c-ea7ac608f93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50dff3e8-23ae-4501-b36a-35a1b3629b13", "name": "network-vif-plugged", "status": "completed", "tag": "5979e202-897a-4341-9c8c-f0e2c941d24d"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:54.292500 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-efc40dc2-fa7b-446d-aad3-bfc5738f96cf req-21cdd9b2-ab7c-4ec2-ab0c-ea7ac608f93d service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:54.293009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-efc40dc2-fa7b-446d-aad3-bfc5738f96cf req-21cdd9b2-ab7c-4ec2-ab0c-ea7ac608f93d service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:54.293438 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-efc40dc2-fa7b-446d-aad3-bfc5738f96cf req-21cdd9b2-ab7c-4ec2-ab0c-ea7ac608f93d service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:54.304959 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-efc40dc2-fa7b-446d-aad3-bfc5738f96cf req-21cdd9b2-ab7c-4ec2-ab0c-ea7ac608f93d service nova] Creating event network-vif-plugged:5979e202-897a-4341-9c8c-f0e2c941d24d for instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 on hv-cinder-85061 Sep 19 12:30:54.310480 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-efc40dc2-fa7b-446d-aad3-bfc5738f96cf req-21cdd9b2-ab7c-4ec2-ab0c-ea7ac608f93d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035925 Sep 19 12:30:54.311081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 238/472] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:30:54.317721 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-b8c971a6-9a3b-4578-8679-270b67368296 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:54.326467 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-b8c971a6-9a3b-4578-8679-270b67368296 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1672 microversion: 2.1 time: 0.419492 Sep 19 12:30:54.327041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 235/473] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:53 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1672 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:54.404463 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-5984f7de-83bf-42e4-b4bc-e887400f92d0 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:54.405187 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-5984f7de-83bf-42e4-b4bc-e887400f92d0 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:54.411221 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5984f7de-83bf-42e4-b4bc-e887400f92d0 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:54.411690 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5984f7de-83bf-42e4-b4bc-e887400f92d0 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:54.412184 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5984f7de-83bf-42e4-b4bc-e887400f92d0 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:54.412926 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5984f7de-83bf-42e4-b4bc-e887400f92d0 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:54.413369 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5984f7de-83bf-42e4-b4bc-e887400f92d0 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:54.413783 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5984f7de-83bf-42e4-b4bc-e887400f92d0 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:54.977168 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5984f7de-83bf-42e4-b4bc-e887400f92d0 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:54.985094 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-5984f7de-83bf-42e4-b4bc-e887400f92d0 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1357 microversion: 2.1 time: 0.584712 Sep 19 12:30:54.985778 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 239/474] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:54 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1357 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:55.295689 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ca1966fb-bffd-44a7-9172-948b73d7545e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:55.296313 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ca1966fb-bffd-44a7-9172-948b73d7545e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:55.302828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ca1966fb-bffd-44a7-9172-948b73d7545e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:55.303313 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ca1966fb-bffd-44a7-9172-948b73d7545e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:55.304423 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ca1966fb-bffd-44a7-9172-948b73d7545e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:55.304527 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ca1966fb-bffd-44a7-9172-948b73d7545e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:55.304949 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ca1966fb-bffd-44a7-9172-948b73d7545e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:55.305374 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ca1966fb-bffd-44a7-9172-948b73d7545e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:55.351426 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-97d9c413-27e4-40b8-9d34-252ed357162c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:55.352362 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-97d9c413-27e4-40b8-9d34-252ed357162c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:55.358626 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-97d9c413-27e4-40b8-9d34-252ed357162c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:55.359103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-97d9c413-27e4-40b8-9d34-252ed357162c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:55.359526 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-97d9c413-27e4-40b8-9d34-252ed357162c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:55.360212 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-97d9c413-27e4-40b8-9d34-252ed357162c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:55.360671 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-97d9c413-27e4-40b8-9d34-252ed357162c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:55.361115 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-97d9c413-27e4-40b8-9d34-252ed357162c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:55.478381 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-97d9c413-27e4-40b8-9d34-252ed357162c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:55.487150 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-97d9c413-27e4-40b8-9d34-252ed357162c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1606 microversion: 2.1 time: 0.140083 Sep 19 12:30:55.487824 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 240/475] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:55 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1606 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:30:55.552269 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ca1966fb-bffd-44a7-9172-948b73d7545e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:55.560562 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:30:55.565893 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ca1966fb-bffd-44a7-9172-948b73d7545e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1368 microversion: 2.1 time: 0.274298 Sep 19 12:30:55.566636 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 236/476] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:55 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1368 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:55.655432 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-55fbda8b-7dad-4898-b3db-c7bb60027987 req-bc0fc885-c8e4-4445-84c4-ecd198941006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded9ef48-10a2-4c68-bf0b-ad0e02e36308", "name": "network-vif-deleted", "tag": "5e58fb6d-79ef-4674-8ba5-094c6cba4cd9"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:55.666823 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-55fbda8b-7dad-4898-b3db-c7bb60027987 req-bc0fc885-c8e4-4445-84c4-ecd198941006 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:55.667675 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-55fbda8b-7dad-4898-b3db-c7bb60027987 req-bc0fc885-c8e4-4445-84c4-ecd198941006 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:55.668214 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-55fbda8b-7dad-4898-b3db-c7bb60027987 req-bc0fc885-c8e4-4445-84c4-ecd198941006 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:55.681134 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-55fbda8b-7dad-4898-b3db-c7bb60027987 req-bc0fc885-c8e4-4445-84c4-ecd198941006 service nova] Creating event network-vif-deleted:5e58fb6d-79ef-4674-8ba5-094c6cba4cd9 for instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 on hv-cinder-85061 Sep 19 12:30:55.686462 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-55fbda8b-7dad-4898-b3db-c7bb60027987 req-bc0fc885-c8e4-4445-84c4-ecd198941006 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034731 Sep 19 12:30:55.687431 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 241/477] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:30:56.008174 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-09816cf8-2fb3-42fa-9267-5b040c91a961 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:56.008858 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-09816cf8-2fb3-42fa-9267-5b040c91a961 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:56.015563 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-09816cf8-2fb3-42fa-9267-5b040c91a961 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:56.016058 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-09816cf8-2fb3-42fa-9267-5b040c91a961 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:56.020328 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-09816cf8-2fb3-42fa-9267-5b040c91a961 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:56.020328 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-09816cf8-2fb3-42fa-9267-5b040c91a961 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:56.020328 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-09816cf8-2fb3-42fa-9267-5b040c91a961 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:56.020328 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-09816cf8-2fb3-42fa-9267-5b040c91a961 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:56.158076 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-09816cf8-2fb3-42fa-9267-5b040c91a961 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:56.166369 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-09816cf8-2fb3-42fa-9267-5b040c91a961 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1548 microversion: 2.1 time: 0.162404 Sep 19 12:30:56.166947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 237/478] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:56 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:56.191324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-7cf1410f-784d-4b26-a8ae-6bed9a72c094 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:56.191324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-7cf1410f-784d-4b26-a8ae-6bed9a72c094 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:56.198278 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7cf1410f-784d-4b26-a8ae-6bed9a72c094 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:56.198758 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7cf1410f-784d-4b26-a8ae-6bed9a72c094 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:56.199246 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7cf1410f-784d-4b26-a8ae-6bed9a72c094 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:56.199944 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7cf1410f-784d-4b26-a8ae-6bed9a72c094 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:56.200420 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7cf1410f-784d-4b26-a8ae-6bed9a72c094 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:56.200864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7cf1410f-784d-4b26-a8ae-6bed9a72c094 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:56.332169 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-7cf1410f-784d-4b26-a8ae-6bed9a72c094 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:56.340689 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-7cf1410f-784d-4b26-a8ae-6bed9a72c094 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1548 microversion: 2.1 time: 0.155057 Sep 19 12:30:56.341319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 242/479] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:56 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:56.362087 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-f95da703-b869-41bf-a0c4-7228b8be43c8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:56.367137 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-f95da703-b869-41bf-a0c4-7228b8be43c8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:56.367896 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-f95da703-b869-41bf-a0c4-7228b8be43c8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Searching by: {'deleted': False, 'project_id': 'e212d8593720481abae6cfa656f03078'} {{(pid=121429) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 12:30:56.375326 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f95da703-b869-41bf-a0c4-7228b8be43c8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:56.375809 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f95da703-b869-41bf-a0c4-7228b8be43c8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:56.376247 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f95da703-b869-41bf-a0c4-7228b8be43c8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:56.377018 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f95da703-b869-41bf-a0c4-7228b8be43c8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:56.377495 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f95da703-b869-41bf-a0c4-7228b8be43c8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:56.377951 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f95da703-b869-41bf-a0c4-7228b8be43c8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:56.472416 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.multi_cell_list [None req-f95da703-b869-41bf-a0c4-7228b8be43c8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121429) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 12:30:56.512931 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-9484c8de-d010-4c8b-ad03-629286b3ff21 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:56.513731 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-9484c8de-d010-4c8b-ad03-629286b3ff21 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:56.520016 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9484c8de-d010-4c8b-ad03-629286b3ff21 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:56.526933 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9484c8de-d010-4c8b-ad03-629286b3ff21 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:56.526933 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9484c8de-d010-4c8b-ad03-629286b3ff21 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:56.526933 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9484c8de-d010-4c8b-ad03-629286b3ff21 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:56.526933 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9484c8de-d010-4c8b-ad03-629286b3ff21 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:56.527440 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9484c8de-d010-4c8b-ad03-629286b3ff21 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:56.572647 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-f95da703-b869-41bf-a0c4-7228b8be43c8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.214275 Sep 19 12:30:56.573572 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 238/480] 10.222.0.93 () {58 vars in 1125 bytes} [Mon Sep 19 12:30:56 2022] GET /compute/v2.1/servers => generated 342 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:30:56.588697 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5dcfd92a-0626-4071-bae2-61f648b8f3c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:56.589567 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-5dcfd92a-0626-4071-bae2-61f648b8f3c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:56.598020 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5dcfd92a-0626-4071-bae2-61f648b8f3c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:56.599022 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5dcfd92a-0626-4071-bae2-61f648b8f3c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:56.599918 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5dcfd92a-0626-4071-bae2-61f648b8f3c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:56.600977 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5dcfd92a-0626-4071-bae2-61f648b8f3c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:56.602546 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5dcfd92a-0626-4071-bae2-61f648b8f3c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:56.602811 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5dcfd92a-0626-4071-bae2-61f648b8f3c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:56.606048 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-9484c8de-d010-4c8b-ad03-629286b3ff21 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:56.616569 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-9484c8de-d010-4c8b-ad03-629286b3ff21 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1323 microversion: 2.1 time: 0.108424 Sep 19 12:30:56.617539 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 243/481] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:56 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1323 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:56.622465 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-3222c39f-0a2d-4f83-b3ff-45ad9d47477b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:56.623053 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-3222c39f-0a2d-4f83-b3ff-45ad9d47477b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:56.632844 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3222c39f-0a2d-4f83-b3ff-45ad9d47477b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:56.633553 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3222c39f-0a2d-4f83-b3ff-45ad9d47477b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:56.634298 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3222c39f-0a2d-4f83-b3ff-45ad9d47477b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:56.635147 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3222c39f-0a2d-4f83-b3ff-45ad9d47477b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:56.635732 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3222c39f-0a2d-4f83-b3ff-45ad9d47477b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:56.636555 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3222c39f-0a2d-4f83-b3ff-45ad9d47477b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:56.801385 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-5dcfd92a-0626-4071-bae2-61f648b8f3c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:56.809825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5dcfd92a-0626-4071-bae2-61f648b8f3c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1548 microversion: 2.1 time: 0.226278 Sep 19 12:30:56.810486 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 239/482] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:56 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1548 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:56.823265 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-3222c39f-0a2d-4f83-b3ff-45ad9d47477b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:56.831167 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-3222c39f-0a2d-4f83-b3ff-45ad9d47477b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1368 microversion: 2.1 time: 0.212421 Sep 19 12:30:56.831925 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 244/483] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:56 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:57.643002 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-aad426ad-d473-4637-9ace-c2213e5c664a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:57.643658 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-aad426ad-d473-4637-9ace-c2213e5c664a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:57.650502 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aad426ad-d473-4637-9ace-c2213e5c664a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:57.650977 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aad426ad-d473-4637-9ace-c2213e5c664a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:57.651405 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aad426ad-d473-4637-9ace-c2213e5c664a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:57.652098 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aad426ad-d473-4637-9ace-c2213e5c664a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:57.652542 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aad426ad-d473-4637-9ace-c2213e5c664a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:57.652988 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aad426ad-d473-4637-9ace-c2213e5c664a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:57.685270 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aad426ad-d473-4637-9ace-c2213e5c664a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:57.686087 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aad426ad-d473-4637-9ace-c2213e5c664a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:57.686271 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aad426ad-d473-4637-9ace-c2213e5c664a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:57.686718 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.objects.instance [None req-aad426ad-d473-4637-9ace-c2213e5c664a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lazy-loading 'fault' on Instance uuid ded9ef48-10a2-4c68-bf0b-ad0e02e36308 {{(pid=121429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:30:57.732062 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-aad426ad-d473-4637-9ace-c2213e5c664a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:57.740188 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-aad426ad-d473-4637-9ace-c2213e5c664a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 200 len: 1328 microversion: 2.1 time: 0.101034 Sep 19 12:30:57.741336 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 240/484] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:57 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:57.854277 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-1130ed5e-ab17-4c4e-863f-1feff4f54436 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:57.854908 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-1130ed5e-ab17-4c4e-863f-1feff4f54436 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:57.861729 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1130ed5e-ab17-4c4e-863f-1feff4f54436 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:57.862201 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1130ed5e-ab17-4c4e-863f-1feff4f54436 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:57.862832 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1130ed5e-ab17-4c4e-863f-1feff4f54436 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:57.863527 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1130ed5e-ab17-4c4e-863f-1feff4f54436 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:57.863962 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1130ed5e-ab17-4c4e-863f-1feff4f54436 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:57.864378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1130ed5e-ab17-4c4e-863f-1feff4f54436 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:57.869259 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=100 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:30:57.998379 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-1130ed5e-ab17-4c4e-863f-1feff4f54436 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:30:58.006001 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-1130ed5e-ab17-4c4e-863f-1feff4f54436 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1558 microversion: 2.1 time: 0.156191 Sep 19 12:30:58.006620 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 245/485] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:57 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:30:58.029648 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3575042f-c9da-4821-86d2-ff687eaf00a6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:58.030134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3575042f-c9da-4821-86d2-ff687eaf00a6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:58.035970 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3575042f-c9da-4821-86d2-ff687eaf00a6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:58.036443 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3575042f-c9da-4821-86d2-ff687eaf00a6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:58.036908 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3575042f-c9da-4821-86d2-ff687eaf00a6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:58.037589 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3575042f-c9da-4821-86d2-ff687eaf00a6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:58.038523 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3575042f-c9da-4821-86d2-ff687eaf00a6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:58.038968 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3575042f-c9da-4821-86d2-ff687eaf00a6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:58.114492 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3575042f-c9da-4821-86d2-ff687eaf00a6 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088692 Sep 19 12:30:58.115341 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 241/486] 10.222.0.93 () {58 vars in 1275 bytes} [Mon Sep 19 12:30:58 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:30:58.765497 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d67aeb64-4863-45a0-801f-c90235e4fd8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:58.766100 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d67aeb64-4863-45a0-801f-c90235e4fd8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:58.773124 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d67aeb64-4863-45a0-801f-c90235e4fd8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:58.773813 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d67aeb64-4863-45a0-801f-c90235e4fd8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:58.774440 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d67aeb64-4863-45a0-801f-c90235e4fd8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:58.775135 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d67aeb64-4863-45a0-801f-c90235e4fd8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:58.775745 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d67aeb64-4863-45a0-801f-c90235e4fd8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:58.776167 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d67aeb64-4863-45a0-801f-c90235e4fd8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:58.800251 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-d67aeb64-4863-45a0-801f-c90235e4fd8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] HTTP exception thrown: Instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 could not be found. Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d67aeb64-4863-45a0-801f-c90235e4fd8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Request method failure captured: Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 HTTP/1.1 Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKF_zyqdRr1FKPHmS2wTNUv6cYsiPzNC_aOLvs14iigPqYOeW3IOokwD8SsTLMUOONE8tBEme5FKwYbtEX0uiP_PxGKupSQrjG8JYZ381t6EqkdppWftoZQENCpxUgO_R3sMDu_NTAZDjYVXR-n3_VeypsXEKz9ZgwpObkXxzO9mxoew Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 61eb996219124e819beda67ca498dee8 Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-AttachVolumeTestJSON-611028865 Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:30:58.802324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:30:58.803690 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/61eb996219124e819beda67ca498dee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_61eb996219124e819beda67ca498dee8", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/61eb996219124e819beda67ca498dee8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/61eb996219124e819beda67ca498dee8"}]}] Sep 19 12:30:58.803690 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-AttachVolumeTestJSON-611028865 Sep 19 12:30:58.803690 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 61eb996219124e819beda67ca498dee8 Sep 19 12:30:58.803690 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-AttachVolumeTestJSON-611028865 Sep 19 12:30:58.803690 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-AttachVolumeTestJSON-611028865-project Sep 19 12:30:58.803690 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:30:58.803690 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:30:58.803690 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: b9f97f3f5c2e41c69961dafa9bdf84e8 Sep 19 12:30:58.803690 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-AttachVolumeTestJSON-611028865-project Sep 19 12:30:58.803690 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:30:58.803690 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 could not be found. Sep 19 12:30:58.803690 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': 'ded9ef48-10a2-4c68-bf0b-ad0e02e36308'} Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 could not be found. Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:30:58.804460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:30:58.806283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:30:58.806283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:30:58.806283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:30:58.806283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:30:58.806283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:30:58.806283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:30:58.806283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:30:58.806283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 could not be found. Sep 19 12:30:58.806283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:30:58.806283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:30:58.806283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:30:58.806283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:30:58.806283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:30:58.806283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:30:58.806283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:30:58.806283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:30:58.806283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 could not be found. Sep 19 12:30:58.806283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:30:58.807405 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d67aeb64-4863-45a0-801f-c90235e4fd8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Returning 404 to user: Instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:30:58.807405 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d67aeb64-4863-45a0-801f-c90235e4fd8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 404 len: 111 microversion: 2.1 time: 0.042678 Sep 19 12:30:58.813768 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3d06df13-529c-41c0-bdd1-53ca8bbff838 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '.version_select at 0x7f54b34cfaf0>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:30:58.820351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 246/487] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:30:58 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:30:58.846834 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-6875080f-f9e7-4d48-b780-269cdf5bf71b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b87378e9-451d-4afb-a69d-3f24ae0d101d"}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:58.851212 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6875080f-f9e7-4d48-b780-269cdf5bf71b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:30:58.855306 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6875080f-f9e7-4d48-b780-269cdf5bf71b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:58.855911 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6875080f-f9e7-4d48-b780-269cdf5bf71b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:58.856191 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6875080f-f9e7-4d48-b780-269cdf5bf71b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:58.856902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6875080f-f9e7-4d48-b780-269cdf5bf71b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:58.857341 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6875080f-f9e7-4d48-b780-269cdf5bf71b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:58.857810 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6875080f-f9e7-4d48-b780-269cdf5bf71b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:58.907164 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3d06df13-529c-41c0-bdd1-53ca8bbff838 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733829618" status: 202 len: 0 microversion: 2.1 time: 0.097540 Sep 19 12:30:58.907937 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 242/488] 10.222.0.93 () {58 vars in 1221 bytes} [Mon Sep 19 12:30:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733829618 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:30:59.221769 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-a8ce6e17-dac0-451f-9ec8-df9acff294e7 req-f96ecaf5-d29a-4719-9038-105e59baf747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50dff3e8-23ae-4501-b36a-35a1b3629b13", "tag": "5979e202-897a-4341-9c8c-f0e2c941d24d"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:59.232349 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-a8ce6e17-dac0-451f-9ec8-df9acff294e7 req-f96ecaf5-d29a-4719-9038-105e59baf747 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:30:59.232927 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-a8ce6e17-dac0-451f-9ec8-df9acff294e7 req-f96ecaf5-d29a-4719-9038-105e59baf747 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:30:59.238487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-a8ce6e17-dac0-451f-9ec8-df9acff294e7 req-f96ecaf5-d29a-4719-9038-105e59baf747 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:30:59.244387 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-a8ce6e17-dac0-451f-9ec8-df9acff294e7 req-f96ecaf5-d29a-4719-9038-105e59baf747 service nova] Creating event network-changed:5979e202-897a-4341-9c8c-f0e2c941d24d for instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 on hv-cinder-85061 Sep 19 12:30:59.249350 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-a8ce6e17-dac0-451f-9ec8-df9acff294e7 req-f96ecaf5-d29a-4719-9038-105e59baf747 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031308 Sep 19 12:30:59.250019 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 243/489] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:30:59.761985 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-6875080f-f9e7-4d48-b780-269cdf5bf71b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "POST /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.918882 Sep 19 12:30:59.763223 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 247/490] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Sep 19 12:30:58 2022] POST /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87/os-volume_attachments => generated 194 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:30:59.909761 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3493f238-6d47-4e18-9c58-34eb4e346d54 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Action: 'create', calling method: .version_select at 0x7f54b33f81f0>, body: {"keypair": {"name": "tempest-keypair-893062961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfq940HtLKM/McUok2VFsDoNds0lz8ioTS2Xhpre18DFJSiDBS82GUJ+s3NSVwMmBYBeiJar3pMdvUz3BjfaYZqu7HMfXfC075AxzhCnPSB10lav0Zc0hA6Qu3nExgz+w=="}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:30:59.932717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-3493f238-6d47-4e18-9c58-34eb4e346d54 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Getting quotas for project 61eb996219124e819beda67ca498dee8. Resources: {'key_pairs'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:30:59.938356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-3493f238-6d47-4e18-9c58-34eb4e346d54 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Getting quotas for user b9f97f3f5c2e41c69961dafa9bdf84e8 and project 61eb996219124e819beda67ca498dee8. Resources: {'key_pairs'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:31:00.056350 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3493f238-6d47-4e18-9c58-34eb4e346d54 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.151097 Sep 19 12:31:00.057109 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 244/491] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Sep 19 12:30:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:31:02.624888 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-744301c2-81aa-4bd7-8022-9cb6685574c5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1891027642", "imageRef": "d4301833-8e96-46bf-a940-692f93f7fdba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd198206-8f2d-4496-8d28-135d50c06a18"}], "security_groups": [{"name": "tempest-securitygroup--19239143"}], "key_name": "tempest-keypair-893062961", "user_data": "}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:31:02.726312 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.network.neutron [None req-744301c2-81aa-4bd7-8022-9cb6685574c5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] validate_networks() for [('fd198206-8f2d-4496-8d28-135d50c06a18', None, None, None, None, None)] {{(pid=121428) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:31:03.099866 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-744301c2-81aa-4bd7-8022-9cb6685574c5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Flavor limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:31:03.100345 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-744301c2-81aa-4bd7-8022-9cb6685574c5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Image limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:31:03.100823 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-744301c2-81aa-4bd7-8022-9cb6685574c5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Flavor pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:31:03.101230 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-744301c2-81aa-4bd7-8022-9cb6685574c5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Image pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:31:03.101638 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-744301c2-81aa-4bd7-8022-9cb6685574c5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:31:03.110369 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-744301c2-81aa-4bd7-8022-9cb6685574c5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:03.110842 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-744301c2-81aa-4bd7-8022-9cb6685574c5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:03.111272 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-744301c2-81aa-4bd7-8022-9cb6685574c5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:03.111986 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-744301c2-81aa-4bd7-8022-9cb6685574c5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:03.112432 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-744301c2-81aa-4bd7-8022-9cb6685574c5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:03.112874 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-744301c2-81aa-4bd7-8022-9cb6685574c5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:03.128978 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-744301c2-81aa-4bd7-8022-9cb6685574c5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Getting quotas for project 61eb996219124e819beda67ca498dee8. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:31:03.133415 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-744301c2-81aa-4bd7-8022-9cb6685574c5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Getting quotas for user b9f97f3f5c2e41c69961dafa9bdf84e8 and project 61eb996219124e819beda67ca498dee8. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:31:03.144565 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-744301c2-81aa-4bd7-8022-9cb6685574c5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Going to run 1 instances... {{(pid=121428) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:31:03.147556 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-744301c2-81aa-4bd7-8022-9cb6685574c5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4301833-8e96-46bf-a940-692f93f7fdba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:31:03.285610 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-744301c2-81aa-4bd7-8022-9cb6685574c5 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.665875 Sep 19 12:31:03.286172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 248/492] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:31:02 2022] POST /compute/v2.1/servers => generated 400 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:31:03.298076 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-75508a4b-34cb-4706-8ff4-efc68bb3c3c2 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:03.300074 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-75508a4b-34cb-4706-8ff4-efc68bb3c3c2 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:03.354039 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-75508a4b-34cb-4706-8ff4-efc68bb3c3c2 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:03.361724 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-75508a4b-34cb-4706-8ff4-efc68bb3c3c2 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 200 len: 1237 microversion: 2.1 time: 0.068122 Sep 19 12:31:03.362628 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 245/493] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:03 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:04.385632 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b0b44b37-947f-4ad8-936b-2b3543b42f05 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:04.386494 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-b0b44b37-947f-4ad8-936b-2b3543b42f05 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:04.393079 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b0b44b37-947f-4ad8-936b-2b3543b42f05 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:04.393604 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b0b44b37-947f-4ad8-936b-2b3543b42f05 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:04.394037 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b0b44b37-947f-4ad8-936b-2b3543b42f05 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:04.394785 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b0b44b37-947f-4ad8-936b-2b3543b42f05 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:04.395237 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b0b44b37-947f-4ad8-936b-2b3543b42f05 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:04.395676 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b0b44b37-947f-4ad8-936b-2b3543b42f05 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:04.457646 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-b0b44b37-947f-4ad8-936b-2b3543b42f05 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:04.465449 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-b0b44b37-947f-4ad8-936b-2b3543b42f05 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 200 len: 1241 microversion: 2.1 time: 0.084869 Sep 19 12:31:04.466022 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 249/494] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:04 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:05.495595 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2cdbd1bf-a3bb-4335-99b5-351dbd8a8126 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:05.496208 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2cdbd1bf-a3bb-4335-99b5-351dbd8a8126 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:05.502883 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2cdbd1bf-a3bb-4335-99b5-351dbd8a8126 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:05.503371 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2cdbd1bf-a3bb-4335-99b5-351dbd8a8126 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:05.503811 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2cdbd1bf-a3bb-4335-99b5-351dbd8a8126 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:05.504510 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2cdbd1bf-a3bb-4335-99b5-351dbd8a8126 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:05.504987 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2cdbd1bf-a3bb-4335-99b5-351dbd8a8126 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:05.505410 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2cdbd1bf-a3bb-4335-99b5-351dbd8a8126 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:05.579737 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2cdbd1bf-a3bb-4335-99b5-351dbd8a8126 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:05.588357 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2cdbd1bf-a3bb-4335-99b5-351dbd8a8126 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 200 len: 1289 microversion: 2.1 time: 0.096626 Sep 19 12:31:05.589300 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 246/495] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:05 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:06.612035 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-4ffe128d-f66e-44c4-85cc-54c7e655b17d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:06.612805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-4ffe128d-f66e-44c4-85cc-54c7e655b17d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:06.620199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4ffe128d-f66e-44c4-85cc-54c7e655b17d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:06.620722 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4ffe128d-f66e-44c4-85cc-54c7e655b17d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:06.621161 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4ffe128d-f66e-44c4-85cc-54c7e655b17d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:06.621871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4ffe128d-f66e-44c4-85cc-54c7e655b17d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:06.622322 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4ffe128d-f66e-44c4-85cc-54c7e655b17d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:06.622745 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4ffe128d-f66e-44c4-85cc-54c7e655b17d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:06.762967 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-4ffe128d-f66e-44c4-85cc-54c7e655b17d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:06.770706 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-4ffe128d-f66e-44c4-85cc-54c7e655b17d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 200 len: 1361 microversion: 2.1 time: 0.162691 Sep 19 12:31:06.771271 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 250/496] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:06 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:07.473909 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-96fd81f4-6493-49a2-892d-55bea3870b2a tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:07.474510 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-96fd81f4-6493-49a2-892d-55bea3870b2a tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:07.477110 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=2 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:31:07.482397 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-96fd81f4-6493-49a2-892d-55bea3870b2a tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:07.482888 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-96fd81f4-6493-49a2-892d-55bea3870b2a tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:07.483326 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-96fd81f4-6493-49a2-892d-55bea3870b2a tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:07.484037 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-96fd81f4-6493-49a2-892d-55bea3870b2a tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:07.484490 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-96fd81f4-6493-49a2-892d-55bea3870b2a tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:07.484949 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-96fd81f4-6493-49a2-892d-55bea3870b2a tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:07.615082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-e1014e8a-9c50-4240-bab0-af776a0809e0 req-2f2776f2-0996-4227-9ce2-e68fc4326665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb2e455-fdfc-4c68-bf38-e569a2797293", "tag": "68701594-a5ca-4fef-a35d-f4b800cc2c64"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:31:07.625430 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-e1014e8a-9c50-4240-bab0-af776a0809e0 req-2f2776f2-0996-4227-9ce2-e68fc4326665 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:07.625906 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-e1014e8a-9c50-4240-bab0-af776a0809e0 req-2f2776f2-0996-4227-9ce2-e68fc4326665 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:07.626331 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-e1014e8a-9c50-4240-bab0-af776a0809e0 req-2f2776f2-0996-4227-9ce2-e68fc4326665 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:07.638516 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-e1014e8a-9c50-4240-bab0-af776a0809e0 req-2f2776f2-0996-4227-9ce2-e68fc4326665 service nova] Creating event network-changed:68701594-a5ca-4fef-a35d-f4b800cc2c64 for instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 on hv-cinder-85061 Sep 19 12:31:07.643957 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-e1014e8a-9c50-4240-bab0-af776a0809e0 req-2f2776f2-0996-4227-9ce2-e68fc4326665 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032387 Sep 19 12:31:07.644558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 251/497] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:31:07.677702 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-96fd81f4-6493-49a2-892d-55bea3870b2a tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:07.686812 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-96fd81f4-6493-49a2-892d-55bea3870b2a tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1594 microversion: 2.1 time: 0.216697 Sep 19 12:31:07.687636 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 247/498] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:07 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1594 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:07.794444 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e19503f0-931c-4aab-90cc-51fa824a4bdd tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:07.795243 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e19503f0-931c-4aab-90cc-51fa824a4bdd tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:07.801729 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e19503f0-931c-4aab-90cc-51fa824a4bdd tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:07.802206 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e19503f0-931c-4aab-90cc-51fa824a4bdd tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:07.802637 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e19503f0-931c-4aab-90cc-51fa824a4bdd tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:07.803357 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e19503f0-931c-4aab-90cc-51fa824a4bdd tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:07.803845 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e19503f0-931c-4aab-90cc-51fa824a4bdd tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:07.804261 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e19503f0-931c-4aab-90cc-51fa824a4bdd tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:08.025028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e19503f0-931c-4aab-90cc-51fa824a4bdd tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:08.034205 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e19503f0-931c-4aab-90cc-51fa824a4bdd tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 200 len: 1361 microversion: 2.1 time: 0.244068 Sep 19 12:31:08.034779 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 252/499] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:07 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:09.057812 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-a7064d8b-e818-4345-bec8-a677601db28a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:09.058454 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-a7064d8b-e818-4345-bec8-a677601db28a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:09.065376 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a7064d8b-e818-4345-bec8-a677601db28a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:09.065860 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a7064d8b-e818-4345-bec8-a677601db28a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:09.066297 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a7064d8b-e818-4345-bec8-a677601db28a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:09.066986 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a7064d8b-e818-4345-bec8-a677601db28a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:09.067437 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a7064d8b-e818-4345-bec8-a677601db28a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:09.067861 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a7064d8b-e818-4345-bec8-a677601db28a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:09.204410 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-a7064d8b-e818-4345-bec8-a677601db28a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:09.209941 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-a7064d8b-e818-4345-bec8-a677601db28a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 200 len: 1361 microversion: 2.1 time: 0.155451 Sep 19 12:31:09.210600 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 248/500] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:09 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:09.688102 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-27bc544e-ff57-400e-8607-3729469006b6 req-c90d8b4a-789a-4605-908e-2ef5fda225f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "006954cd-d599-4bb6-b64e-3fd4d87f8a87", "tag": "83af7231-e989-47cd-984e-6d5a0ed98d98"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:31:09.699972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-27bc544e-ff57-400e-8607-3729469006b6 req-c90d8b4a-789a-4605-908e-2ef5fda225f9 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:09.700456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-27bc544e-ff57-400e-8607-3729469006b6 req-c90d8b4a-789a-4605-908e-2ef5fda225f9 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:09.705943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-27bc544e-ff57-400e-8607-3729469006b6 req-c90d8b4a-789a-4605-908e-2ef5fda225f9 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:09.712400 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-27bc544e-ff57-400e-8607-3729469006b6 req-c90d8b4a-789a-4605-908e-2ef5fda225f9 service nova] Creating event network-changed:83af7231-e989-47cd-984e-6d5a0ed98d98 for instance 006954cd-d599-4bb6-b64e-3fd4d87f8a87 on hv-cinder-85061 Sep 19 12:31:09.717435 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-27bc544e-ff57-400e-8607-3729469006b6 req-c90d8b4a-789a-4605-908e-2ef5fda225f9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032842 Sep 19 12:31:09.718023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 253/501] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:31:10.248195 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-14cd6970-77a5-42e6-854c-4bc4f197c6d6 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:10.248195 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-14cd6970-77a5-42e6-854c-4bc4f197c6d6 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:10.250006 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-14cd6970-77a5-42e6-854c-4bc4f197c6d6 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:10.250505 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-14cd6970-77a5-42e6-854c-4bc4f197c6d6 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:10.250943 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-14cd6970-77a5-42e6-854c-4bc4f197c6d6 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:10.252232 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-14cd6970-77a5-42e6-854c-4bc4f197c6d6 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:10.252891 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-14cd6970-77a5-42e6-854c-4bc4f197c6d6 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:10.253387 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-14cd6970-77a5-42e6-854c-4bc4f197c6d6 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:10.570582 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-14cd6970-77a5-42e6-854c-4bc4f197c6d6 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:10.578010 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-14cd6970-77a5-42e6-854c-4bc4f197c6d6 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 200 len: 1361 microversion: 2.1 time: 0.347887 Sep 19 12:31:10.578577 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 249/502] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:10 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 1361 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:11.601420 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-eb6768e7-126b-4416-becc-9b4635de9817 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:11.602126 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-eb6768e7-126b-4416-becc-9b4635de9817 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:11.608174 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-eb6768e7-126b-4416-becc-9b4635de9817 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:11.608686 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-eb6768e7-126b-4416-becc-9b4635de9817 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:11.609188 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-eb6768e7-126b-4416-becc-9b4635de9817 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:11.609823 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-eb6768e7-126b-4416-becc-9b4635de9817 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:11.610346 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-eb6768e7-126b-4416-becc-9b4635de9817 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:11.610770 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-eb6768e7-126b-4416-becc-9b4635de9817 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:11.743760 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-eb6768e7-126b-4416-becc-9b4635de9817 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:11.752055 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-eb6768e7-126b-4416-becc-9b4635de9817 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 200 len: 1361 microversion: 2.1 time: 0.155245 Sep 19 12:31:11.752648 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 254/503] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:11 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:12.776012 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-25059ccb-9b79-4c3e-9640-40731b556002 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:12.783080 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-25059ccb-9b79-4c3e-9640-40731b556002 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:12.783080 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-25059ccb-9b79-4c3e-9640-40731b556002 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:12.783466 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-25059ccb-9b79-4c3e-9640-40731b556002 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:12.783890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-25059ccb-9b79-4c3e-9640-40731b556002 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:12.784574 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-25059ccb-9b79-4c3e-9640-40731b556002 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:12.785039 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-25059ccb-9b79-4c3e-9640-40731b556002 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:12.785454 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-25059ccb-9b79-4c3e-9640-40731b556002 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:12.916286 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-25059ccb-9b79-4c3e-9640-40731b556002 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:12.924046 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-25059ccb-9b79-4c3e-9640-40731b556002 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 200 len: 1361 microversion: 2.1 time: 0.152369 Sep 19 12:31:12.924637 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 250/504] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:12 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:13.308852 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8386c1da-b5c5-4015-a699-b522fcb863ea tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-554250448"}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:31:13.308852 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-8386c1da-b5c5-4015-a699-b522fcb863ea tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:13.308852 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=2 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:31:13.308852 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=6 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:31:13.312689 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8386c1da-b5c5-4015-a699-b522fcb863ea tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:13.313180 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8386c1da-b5c5-4015-a699-b522fcb863ea tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:13.313611 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8386c1da-b5c5-4015-a699-b522fcb863ea tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:13.314392 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8386c1da-b5c5-4015-a699-b522fcb863ea tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:13.314781 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8386c1da-b5c5-4015-a699-b522fcb863ea tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:13.315209 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8386c1da-b5c5-4015-a699-b522fcb863ea tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:13.441020 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.network.security_group_api [None req-8386c1da-b5c5-4015-a699-b522fcb863ea tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Adding security group d060d448-3d7d-4210-a4c8-79b2239514ac to port 83af7231-e989-47cd-984e-6d5a0ed98d98 Sep 19 12:31:13.828043 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8386c1da-b5c5-4015-a699-b522fcb863ea tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "POST /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87/action" status: 202 len: 0 microversion: 2.1 time: 0.527765 Sep 19 12:31:13.828887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 255/505] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Sep 19 12:31:13 2022] POST /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:31:13.839349 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b908d043-2ff6-45fb-8bc5-11e047981090 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:13.841390 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b908d043-2ff6-45fb-8bc5-11e047981090 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:13.847750 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=6 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:31:13.851368 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-d4097b1c-ef68-48ca-b333-15483fbab30b req-60a8ba2b-225b-4a63-ab7e-d020f2e6819c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "006954cd-d599-4bb6-b64e-3fd4d87f8a87", "tag": "83af7231-e989-47cd-984e-6d5a0ed98d98"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:31:13.853000 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:31:13.854414 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b908d043-2ff6-45fb-8bc5-11e047981090 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:13.855172 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b908d043-2ff6-45fb-8bc5-11e047981090 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:13.855375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b908d043-2ff6-45fb-8bc5-11e047981090 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:13.857860 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b908d043-2ff6-45fb-8bc5-11e047981090 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:13.859005 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b908d043-2ff6-45fb-8bc5-11e047981090 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:13.860643 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b908d043-2ff6-45fb-8bc5-11e047981090 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:13.876387 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-d4097b1c-ef68-48ca-b333-15483fbab30b req-60a8ba2b-225b-4a63-ab7e-d020f2e6819c service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:13.876888 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-d4097b1c-ef68-48ca-b333-15483fbab30b req-60a8ba2b-225b-4a63-ab7e-d020f2e6819c service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:13.877646 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-d4097b1c-ef68-48ca-b333-15483fbab30b req-60a8ba2b-225b-4a63-ab7e-d020f2e6819c service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:13.891750 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-d4097b1c-ef68-48ca-b333-15483fbab30b req-60a8ba2b-225b-4a63-ab7e-d020f2e6819c service nova] Creating event network-changed:83af7231-e989-47cd-984e-6d5a0ed98d98 for instance 006954cd-d599-4bb6-b64e-3fd4d87f8a87 on hv-cinder-85061 Sep 19 12:31:13.898907 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-d4097b1c-ef68-48ca-b333-15483fbab30b req-60a8ba2b-225b-4a63-ab7e-d020f2e6819c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052621 Sep 19 12:31:13.899743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 256/506] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:31:13.950671 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d3d53956-bea4-4dcb-8f67-b49a38f5a399 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:13.952310 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d3d53956-bea4-4dcb-8f67-b49a38f5a399 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:13.959117 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3d53956-bea4-4dcb-8f67-b49a38f5a399 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:13.959710 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3d53956-bea4-4dcb-8f67-b49a38f5a399 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:13.960242 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3d53956-bea4-4dcb-8f67-b49a38f5a399 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:13.961208 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3d53956-bea4-4dcb-8f67-b49a38f5a399 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:13.961734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3d53956-bea4-4dcb-8f67-b49a38f5a399 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:13.962373 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3d53956-bea4-4dcb-8f67-b49a38f5a399 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:14.154443 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-b908d043-2ff6-45fb-8bc5-11e047981090 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:14.163352 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-b908d043-2ff6-45fb-8bc5-11e047981090 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1758 microversion: 2.1 time: 0.329707 Sep 19 12:31:14.163938 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 251/507] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:13 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1758 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:14.270645 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-d3d53956-bea4-4dcb-8f67-b49a38f5a399 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:14.284032 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d3d53956-bea4-4dcb-8f67-b49a38f5a399 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 200 len: 1361 microversion: 2.1 time: 0.340701 Sep 19 12:31:14.285728 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 257/508] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:13 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 1361 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:31:14.387468 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-47065f26-8248-45ec-967e-f20d9b50c1a3 req-06c20397-726f-4f32-aea4-81ca49c7dbe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb2e455-fdfc-4c68-bf38-e569a2797293", "name": "network-vif-plugged", "status": "completed", "tag": "68701594-a5ca-4fef-a35d-f4b800cc2c64"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:31:14.398123 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-47065f26-8248-45ec-967e-f20d9b50c1a3 req-06c20397-726f-4f32-aea4-81ca49c7dbe8 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:14.398594 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-47065f26-8248-45ec-967e-f20d9b50c1a3 req-06c20397-726f-4f32-aea4-81ca49c7dbe8 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:14.399222 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-47065f26-8248-45ec-967e-f20d9b50c1a3 req-06c20397-726f-4f32-aea4-81ca49c7dbe8 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:14.410770 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-47065f26-8248-45ec-967e-f20d9b50c1a3 req-06c20397-726f-4f32-aea4-81ca49c7dbe8 service nova] Creating event network-vif-plugged:68701594-a5ca-4fef-a35d-f4b800cc2c64 for instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 on hv-cinder-85061 Sep 19 12:31:14.417558 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-47065f26-8248-45ec-967e-f20d9b50c1a3 req-06c20397-726f-4f32-aea4-81ca49c7dbe8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032797 Sep 19 12:31:14.417558 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 252/509] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:31:15.307204 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c36a2392-7eb1-4926-a06a-d112cfb5090a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:15.307855 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c36a2392-7eb1-4926-a06a-d112cfb5090a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:15.314136 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c36a2392-7eb1-4926-a06a-d112cfb5090a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:15.314614 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c36a2392-7eb1-4926-a06a-d112cfb5090a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:15.315042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c36a2392-7eb1-4926-a06a-d112cfb5090a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:15.315719 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c36a2392-7eb1-4926-a06a-d112cfb5090a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:15.316165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c36a2392-7eb1-4926-a06a-d112cfb5090a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:15.316587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c36a2392-7eb1-4926-a06a-d112cfb5090a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:15.445315 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c36a2392-7eb1-4926-a06a-d112cfb5090a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:15.452778 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c36a2392-7eb1-4926-a06a-d112cfb5090a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 200 len: 1361 microversion: 2.1 time: 0.149386 Sep 19 12:31:15.453340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 258/510] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:15 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:16.477512 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-97c6af58-bea1-43e7-be55-1132cf1f7483 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:16.478116 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-97c6af58-bea1-43e7-be55-1132cf1f7483 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:16.484269 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-97c6af58-bea1-43e7-be55-1132cf1f7483 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:16.484778 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-97c6af58-bea1-43e7-be55-1132cf1f7483 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:16.485210 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-97c6af58-bea1-43e7-be55-1132cf1f7483 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:16.485894 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-97c6af58-bea1-43e7-be55-1132cf1f7483 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:16.486340 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-97c6af58-bea1-43e7-be55-1132cf1f7483 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:16.486758 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-97c6af58-bea1-43e7-be55-1132cf1f7483 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:16.614900 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-97c6af58-bea1-43e7-be55-1132cf1f7483 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:16.622663 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-97c6af58-bea1-43e7-be55-1132cf1f7483 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 200 len: 1361 microversion: 2.1 time: 0.150901 Sep 19 12:31:16.623232 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 253/511] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:16 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:17.647170 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-30920fd5-e884-440c-b8b6-1955e871cd9b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:17.647775 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-30920fd5-e884-440c-b8b6-1955e871cd9b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:17.654253 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-30920fd5-e884-440c-b8b6-1955e871cd9b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:17.654725 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-30920fd5-e884-440c-b8b6-1955e871cd9b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:17.655152 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-30920fd5-e884-440c-b8b6-1955e871cd9b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:17.655829 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-30920fd5-e884-440c-b8b6-1955e871cd9b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:17.656270 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-30920fd5-e884-440c-b8b6-1955e871cd9b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:17.656745 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-30920fd5-e884-440c-b8b6-1955e871cd9b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:17.788876 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-30920fd5-e884-440c-b8b6-1955e871cd9b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:17.796979 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-30920fd5-e884-440c-b8b6-1955e871cd9b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 200 len: 1546 microversion: 2.1 time: 0.154138 Sep 19 12:31:17.797547 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 259/512] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:17 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:17.820882 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9ee2d389-8791-43fd-9aee-572a55761587 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:17.821444 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9ee2d389-8791-43fd-9aee-572a55761587 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:17.827398 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9ee2d389-8791-43fd-9aee-572a55761587 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:17.827882 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9ee2d389-8791-43fd-9aee-572a55761587 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:17.828319 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9ee2d389-8791-43fd-9aee-572a55761587 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:17.829040 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9ee2d389-8791-43fd-9aee-572a55761587 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:17.829495 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9ee2d389-8791-43fd-9aee-572a55761587 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:17.829923 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9ee2d389-8791-43fd-9aee-572a55761587 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:17.904337 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9ee2d389-8791-43fd-9aee-572a55761587 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088148 Sep 19 12:31:17.904989 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 254/513] 10.222.0.93 () {58 vars in 1275 bytes} [Mon Sep 19 12:31:17 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:31:19.521884 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-ee36a00b-0cd8-4784-9002-57b3d5bd7266 req-d32daa20-e237-4ad7-a462-ccef960620ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb2e455-fdfc-4c68-bf38-e569a2797293", "tag": "68701594-a5ca-4fef-a35d-f4b800cc2c64"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:31:19.533150 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-ee36a00b-0cd8-4784-9002-57b3d5bd7266 req-d32daa20-e237-4ad7-a462-ccef960620ef service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:19.533628 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-ee36a00b-0cd8-4784-9002-57b3d5bd7266 req-d32daa20-e237-4ad7-a462-ccef960620ef service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:19.534077 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-ee36a00b-0cd8-4784-9002-57b3d5bd7266 req-d32daa20-e237-4ad7-a462-ccef960620ef service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:19.546451 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-ee36a00b-0cd8-4784-9002-57b3d5bd7266 req-d32daa20-e237-4ad7-a462-ccef960620ef service nova] Creating event network-changed:68701594-a5ca-4fef-a35d-f4b800cc2c64 for instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 on hv-cinder-85061 Sep 19 12:31:19.551748 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-ee36a00b-0cd8-4784-9002-57b3d5bd7266 req-d32daa20-e237-4ad7-a462-ccef960620ef service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036846 Sep 19 12:31:19.552728 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 260/514] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:31:28.518373 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=7 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:31:28.519158 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=82 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:31:28.523255 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c358b886-bb14-4fe7-8782-d46058fcb446 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:28.523754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c358b886-bb14-4fe7-8782-d46058fcb446 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:28.529988 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c358b886-bb14-4fe7-8782-d46058fcb446 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:28.532799 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c358b886-bb14-4fe7-8782-d46058fcb446 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:28.532799 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c358b886-bb14-4fe7-8782-d46058fcb446 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:28.532799 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c358b886-bb14-4fe7-8782-d46058fcb446 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:28.532799 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c358b886-bb14-4fe7-8782-d46058fcb446 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:28.533381 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c358b886-bb14-4fe7-8782-d46058fcb446 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:28.615129 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.objects.instance [None req-c358b886-bb14-4fe7-8782-d46058fcb446 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lazy-loading 'services' on Instance uuid ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 {{(pid=121429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:31:28.811657 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c358b886-bb14-4fe7-8782-d46058fcb446 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/os-volume_attachments/b2184f08-7c84-48ac-9dc6-bfdb1169ab22" status: 202 len: 0 microversion: 2.1 time: 0.294651 Sep 19 12:31:28.812323 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 255/515] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Sep 19 12:31:28 2022] DELETE /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/os-volume_attachments/b2184f08-7c84-48ac-9dc6-bfdb1169ab22 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:31:28.821435 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e0562f55-0a6a-4abe-8e31-9a9625acbd6d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:28.823807 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e0562f55-0a6a-4abe-8e31-9a9625acbd6d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:28.826463 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:31:28.836430 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e0562f55-0a6a-4abe-8e31-9a9625acbd6d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:28.836943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e0562f55-0a6a-4abe-8e31-9a9625acbd6d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:28.848619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e0562f55-0a6a-4abe-8e31-9a9625acbd6d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:28.848619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e0562f55-0a6a-4abe-8e31-9a9625acbd6d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:28.848619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e0562f55-0a6a-4abe-8e31-9a9625acbd6d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:28.848619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e0562f55-0a6a-4abe-8e31-9a9625acbd6d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:28.849048 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:31:28.873261 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e0562f55-0a6a-4abe-8e31-9a9625acbd6d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056174 Sep 19 12:31:28.889813 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 261/516] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Sep 19 12:31:28 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:31:29.887899 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4e64147c-7108-4e7c-8e10-b70ba6f628e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:29.890245 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4e64147c-7108-4e7c-8e10-b70ba6f628e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:29.896589 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4e64147c-7108-4e7c-8e10-b70ba6f628e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:29.897149 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4e64147c-7108-4e7c-8e10-b70ba6f628e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:29.897578 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4e64147c-7108-4e7c-8e10-b70ba6f628e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:29.898270 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4e64147c-7108-4e7c-8e10-b70ba6f628e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:29.898758 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4e64147c-7108-4e7c-8e10-b70ba6f628e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:29.899180 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4e64147c-7108-4e7c-8e10-b70ba6f628e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:29.936187 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4e64147c-7108-4e7c-8e10-b70ba6f628e4 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054073 Sep 19 12:31:29.936797 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 256/517] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Sep 19 12:31:29 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:31:30.949959 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-52ebe977-ba2b-47fc-b998-e804e129533d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:30.953713 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-52ebe977-ba2b-47fc-b998-e804e129533d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:30.960564 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-52ebe977-ba2b-47fc-b998-e804e129533d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:30.961063 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-52ebe977-ba2b-47fc-b998-e804e129533d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:30.961491 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-52ebe977-ba2b-47fc-b998-e804e129533d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:30.962185 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-52ebe977-ba2b-47fc-b998-e804e129533d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:30.962620 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-52ebe977-ba2b-47fc-b998-e804e129533d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:30.963039 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-52ebe977-ba2b-47fc-b998-e804e129533d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:30.991892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-52ebe977-ba2b-47fc-b998-e804e129533d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046517 Sep 19 12:31:30.992444 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 262/518] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Sep 19 12:31:30 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 12:31:31.070884 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-41933e32-e07d-4b51-a44e-aca54e648196 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:31.071421 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-41933e32-e07d-4b51-a44e-aca54e648196 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:31.077944 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-41933e32-e07d-4b51-a44e-aca54e648196 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:31.078422 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-41933e32-e07d-4b51-a44e-aca54e648196 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:31.079542 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-41933e32-e07d-4b51-a44e-aca54e648196 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:31.079697 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-41933e32-e07d-4b51-a44e-aca54e648196 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:31.080156 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-41933e32-e07d-4b51-a44e-aca54e648196 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:31.080577 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-41933e32-e07d-4b51-a44e-aca54e648196 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:31.106852 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-41933e32-e07d-4b51-a44e-aca54e648196 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Going to try to terminate instance {{(pid=121429) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:31:31.391420 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-41933e32-e07d-4b51-a44e-aca54e648196 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 204 len: 0 microversion: 2.1 time: 0.324702 Sep 19 12:31:31.392019 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 257/519] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:31:31 2022] DELETE /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:31:31.401992 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-25511eb5-6c08-49f3-b18d-e1a542c1c897 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:31.402621 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-25511eb5-6c08-49f3-b18d-e1a542c1c897 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:31.410443 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-25511eb5-6c08-49f3-b18d-e1a542c1c897 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:31.410927 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-25511eb5-6c08-49f3-b18d-e1a542c1c897 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:31.411362 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-25511eb5-6c08-49f3-b18d-e1a542c1c897 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:31.412065 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-25511eb5-6c08-49f3-b18d-e1a542c1c897 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:31.412512 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-25511eb5-6c08-49f3-b18d-e1a542c1c897 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:31.412964 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-25511eb5-6c08-49f3-b18d-e1a542c1c897 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:31.560324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-25511eb5-6c08-49f3-b18d-e1a542c1c897 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:31.568629 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-25511eb5-6c08-49f3-b18d-e1a542c1c897 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1685 microversion: 2.1 time: 0.171927 Sep 19 12:31:31.571626 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 263/520] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:31 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:31:32.592654 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-57c1e645-8908-4afe-ba41-6cdc345ba4f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:32.593366 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-57c1e645-8908-4afe-ba41-6cdc345ba4f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:32.600416 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-57c1e645-8908-4afe-ba41-6cdc345ba4f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:32.601034 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-57c1e645-8908-4afe-ba41-6cdc345ba4f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:32.601472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-57c1e645-8908-4afe-ba41-6cdc345ba4f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:32.602181 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-57c1e645-8908-4afe-ba41-6cdc345ba4f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:32.602631 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-57c1e645-8908-4afe-ba41-6cdc345ba4f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:32.603085 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-57c1e645-8908-4afe-ba41-6cdc345ba4f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:32.741353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-57c1e645-8908-4afe-ba41-6cdc345ba4f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:32.749029 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-57c1e645-8908-4afe-ba41-6cdc345ba4f1 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1685 microversion: 2.1 time: 0.160677 Sep 19 12:31:32.749596 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 258/521] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:32 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:33.773123 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f4c822d5-fbaf-43e9-912a-2e0d5fc8809f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:33.774414 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f4c822d5-fbaf-43e9-912a-2e0d5fc8809f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:33.781069 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4c822d5-fbaf-43e9-912a-2e0d5fc8809f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:33.781556 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4c822d5-fbaf-43e9-912a-2e0d5fc8809f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:33.781981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4c822d5-fbaf-43e9-912a-2e0d5fc8809f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:33.782693 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4c822d5-fbaf-43e9-912a-2e0d5fc8809f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:33.783136 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4c822d5-fbaf-43e9-912a-2e0d5fc8809f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:33.783580 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f4c822d5-fbaf-43e9-912a-2e0d5fc8809f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:33.918570 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f4c822d5-fbaf-43e9-912a-2e0d5fc8809f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:33.926341 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f4c822d5-fbaf-43e9-912a-2e0d5fc8809f tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1685 microversion: 2.1 time: 0.157197 Sep 19 12:31:33.926911 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 264/522] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:33 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:34.950072 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-893c6765-4669-4a97-bcf1-c4a8e8142e31 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:34.950704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-893c6765-4669-4a97-bcf1-c4a8e8142e31 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:34.957333 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-893c6765-4669-4a97-bcf1-c4a8e8142e31 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:34.957810 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-893c6765-4669-4a97-bcf1-c4a8e8142e31 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:34.958238 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-893c6765-4669-4a97-bcf1-c4a8e8142e31 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:34.958928 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-893c6765-4669-4a97-bcf1-c4a8e8142e31 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:34.959370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-893c6765-4669-4a97-bcf1-c4a8e8142e31 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:34.959788 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-893c6765-4669-4a97-bcf1-c4a8e8142e31 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:35.093700 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-893c6765-4669-4a97-bcf1-c4a8e8142e31 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:35.103171 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-893c6765-4669-4a97-bcf1-c4a8e8142e31 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1685 microversion: 2.1 time: 0.156330 Sep 19 12:31:35.105575 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 259/523] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:34 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:36.127039 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ba4a990b-9cfb-4acf-892c-0da2ff081860 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:36.127902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-ba4a990b-9cfb-4acf-892c-0da2ff081860 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:36.134513 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ba4a990b-9cfb-4acf-892c-0da2ff081860 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:36.135333 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ba4a990b-9cfb-4acf-892c-0da2ff081860 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:36.135763 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ba4a990b-9cfb-4acf-892c-0da2ff081860 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:36.136447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ba4a990b-9cfb-4acf-892c-0da2ff081860 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:36.136915 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ba4a990b-9cfb-4acf-892c-0da2ff081860 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:36.137361 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ba4a990b-9cfb-4acf-892c-0da2ff081860 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:36.232213 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-ba4a990b-9cfb-4acf-892c-0da2ff081860 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:36.240229 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ba4a990b-9cfb-4acf-892c-0da2ff081860 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1618 microversion: 2.1 time: 0.117304 Sep 19 12:31:36.241222 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 265/524] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:36 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1618 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:36.299283 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-d2f0880a-5181-4463-bbf9-d1adde899e71 req-5daf1e1d-22cb-4e2a-b9d7-f4984e92cd7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5", "name": "network-vif-deleted", "tag": "e85fffd8-bc70-45a1-bd7d-55d41cea22d2"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:31:36.309863 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-d2f0880a-5181-4463-bbf9-d1adde899e71 req-5daf1e1d-22cb-4e2a-b9d7-f4984e92cd7c service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:36.310337 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-d2f0880a-5181-4463-bbf9-d1adde899e71 req-5daf1e1d-22cb-4e2a-b9d7-f4984e92cd7c service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:36.310771 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-d2f0880a-5181-4463-bbf9-d1adde899e71 req-5daf1e1d-22cb-4e2a-b9d7-f4984e92cd7c service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:36.322837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-d2f0880a-5181-4463-bbf9-d1adde899e71 req-5daf1e1d-22cb-4e2a-b9d7-f4984e92cd7c service nova] Creating event network-vif-deleted:e85fffd8-bc70-45a1-bd7d-55d41cea22d2 for instance ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 on hv-cinder-85061 Sep 19 12:31:36.327859 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-d2f0880a-5181-4463-bbf9-d1adde899e71 req-5daf1e1d-22cb-4e2a-b9d7-f4984e92cd7c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032222 Sep 19 12:31:36.328854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 260/525] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:31:36.652166 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-58cc8e1b-5597-4e22-8067-9acfde74c517 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:31:36.654439 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-58cc8e1b-5597-4e22-8067-9acfde74c517 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:36.660671 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-58cc8e1b-5597-4e22-8067-9acfde74c517 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:36.661163 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-58cc8e1b-5597-4e22-8067-9acfde74c517 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:36.661597 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-58cc8e1b-5597-4e22-8067-9acfde74c517 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:36.662298 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-58cc8e1b-5597-4e22-8067-9acfde74c517 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:36.662993 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-58cc8e1b-5597-4e22-8067-9acfde74c517 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:36.663423 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-58cc8e1b-5597-4e22-8067-9acfde74c517 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:36.918979 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-58cc8e1b-5597-4e22-8067-9acfde74c517 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "POST /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87/action" status: 202 len: 0 microversion: 2.1 time: 0.268223 Sep 19 12:31:36.920759 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 266/526] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Sep 19 12:31:36 2022] POST /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:31:36.936854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3b338a90-8787-465c-a784-e6db6b6afcfe tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:36.937596 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3b338a90-8787-465c-a784-e6db6b6afcfe tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:36.945035 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b338a90-8787-465c-a784-e6db6b6afcfe tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:36.945544 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b338a90-8787-465c-a784-e6db6b6afcfe tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:36.945974 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b338a90-8787-465c-a784-e6db6b6afcfe tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:36.946842 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b338a90-8787-465c-a784-e6db6b6afcfe tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:36.947252 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b338a90-8787-465c-a784-e6db6b6afcfe tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:36.947633 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b338a90-8787-465c-a784-e6db6b6afcfe tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:37.104466 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3b338a90-8787-465c-a784-e6db6b6afcfe tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:37.113003 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3b338a90-8787-465c-a784-e6db6b6afcfe tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1750 microversion: 2.1 time: 0.184923 Sep 19 12:31:37.113584 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 261/527] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:36 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:37.264468 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-bd40f083-028c-4656-91e8-75f4cc0a050a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:37.265289 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-bd40f083-028c-4656-91e8-75f4cc0a050a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:37.272383 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bd40f083-028c-4656-91e8-75f4cc0a050a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:37.272917 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bd40f083-028c-4656-91e8-75f4cc0a050a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:37.273880 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bd40f083-028c-4656-91e8-75f4cc0a050a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:37.274196 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bd40f083-028c-4656-91e8-75f4cc0a050a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:37.274646 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bd40f083-028c-4656-91e8-75f4cc0a050a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:37.275593 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bd40f083-028c-4656-91e8-75f4cc0a050a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:37.317528 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bd40f083-028c-4656-91e8-75f4cc0a050a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:37.318023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bd40f083-028c-4656-91e8-75f4cc0a050a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:37.318724 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bd40f083-028c-4656-91e8-75f4cc0a050a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:37.321243 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-bd40f083-028c-4656-91e8-75f4cc0a050a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lazy-loading 'fault' on Instance uuid ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:31:37.386862 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-bd40f083-028c-4656-91e8-75f4cc0a050a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:37.394699 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-bd40f083-028c-4656-91e8-75f4cc0a050a tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 200 len: 1333 microversion: 2.1 time: 0.135050 Sep 19 12:31:37.395247 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 267/528] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:37 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 1333 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:38.137808 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-1b931c57-94ed-438f-8043-533a81632b92 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:38.138404 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-1b931c57-94ed-438f-8043-533a81632b92 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:38.144843 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1b931c57-94ed-438f-8043-533a81632b92 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:38.145328 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1b931c57-94ed-438f-8043-533a81632b92 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:38.145764 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1b931c57-94ed-438f-8043-533a81632b92 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:38.146454 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1b931c57-94ed-438f-8043-533a81632b92 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:38.146904 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1b931c57-94ed-438f-8043-533a81632b92 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:38.147324 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1b931c57-94ed-438f-8043-533a81632b92 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:38.294151 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-1b931c57-94ed-438f-8043-533a81632b92 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:38.302306 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-1b931c57-94ed-438f-8043-533a81632b92 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1755 microversion: 2.1 time: 0.169371 Sep 19 12:31:38.302869 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 262/529] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:38 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:38.419579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-2f7424d6-70d0-4452-88a4-eb68194f73b6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:38.420148 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-2f7424d6-70d0-4452-88a4-eb68194f73b6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:38.427000 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f7424d6-70d0-4452-88a4-eb68194f73b6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:38.427485 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f7424d6-70d0-4452-88a4-eb68194f73b6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:38.427919 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f7424d6-70d0-4452-88a4-eb68194f73b6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:38.428653 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f7424d6-70d0-4452-88a4-eb68194f73b6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:38.429099 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f7424d6-70d0-4452-88a4-eb68194f73b6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:38.429521 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f7424d6-70d0-4452-88a4-eb68194f73b6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:38.445876 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-2f7424d6-70d0-4452-88a4-eb68194f73b6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] HTTP exception thrown: Instance ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 could not be found. Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-2f7424d6-70d0-4452-88a4-eb68194f73b6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Request method failure captured: Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 HTTP/1.1 Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKF_tWWphb1JAPvN-EIEQSK52IRz3n-JW79g8MyFMBDW4gW63g8tf-8d7IlXyjaWL-wltQwHjjhVXyF95eo-sDcZPzinRtVOt-jy7eoPO5RoogsMqWYA2aauMqxMNdK7rALFC559OD52R_2prEh0aku1gmbjxDr3u7abPo2C0r5Yj86w Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: b4cb72be6f7d411fbfd037aebc273cb2 Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1257684246 Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:31:38.448086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:31:38.449753 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4cb72be6f7d411fbfd037aebc273cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b4cb72be6f7d411fbfd037aebc273cb2", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4cb72be6f7d411fbfd037aebc273cb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b4cb72be6f7d411fbfd037aebc273cb2"}]}] Sep 19 12:31:38.449753 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1257684246 Sep 19 12:31:38.449753 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: b4cb72be6f7d411fbfd037aebc273cb2 Sep 19 12:31:38.449753 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1257684246 Sep 19 12:31:38.449753 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-ServerRescueNegativeTestJSON-1257684246-project Sep 19 12:31:38.449753 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:31:38.449753 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:31:38.449753 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: 90ec87808ac641329bc1491d1b5473d9 Sep 19 12:31:38.449753 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1257684246-project Sep 19 12:31:38.449753 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:31:38.449753 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 could not be found. Sep 19 12:31:38.449753 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': 'ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5'} Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 could not be found. Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:31:38.450587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:31:38.451966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:31:38.451966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:31:38.451966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:31:38.451966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:31:38.451966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:31:38.451966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:31:38.451966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:31:38.451966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 could not be found. Sep 19 12:31:38.451966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:31:38.451966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:31:38.451966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:31:38.451966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:31:38.451966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:31:38.451966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:31:38.451966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:31:38.451966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:31:38.451966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 could not be found. Sep 19 12:31:38.451966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:31:38.453603 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-2f7424d6-70d0-4452-88a4-eb68194f73b6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Returning 404 to user: Instance ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:31:38.453603 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-2f7424d6-70d0-4452-88a4-eb68194f73b6 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5" status: 404 len: 111 microversion: 2.1 time: 0.034206 Sep 19 12:31:38.453603 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 268/530] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:38 2022] GET /compute/v2.1/servers/ff691018-8ff1-4b6a-8a6d-cc9735fa8ee5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:31:38.459651 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-f6a49e1e-3ca7-4260-8060-b78e7500186c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '.version_select at 0x7f54b3584040>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:38.538328 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-f6a49e1e-3ca7-4260-8060-b78e7500186c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-16208924" status: 202 len: 0 microversion: 2.1 time: 0.083495 Sep 19 12:31:38.538948 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 263/531] 10.222.0.93 () {58 vars in 1215 bytes} [Mon Sep 19 12:31:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-16208924 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:31:39.326236 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-38c2be3d-97b1-47ad-8786-027a64aca1ae tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:39.326940 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-38c2be3d-97b1-47ad-8786-027a64aca1ae tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:39.334234 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-38c2be3d-97b1-47ad-8786-027a64aca1ae tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:39.334715 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-38c2be3d-97b1-47ad-8786-027a64aca1ae tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:39.335269 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-38c2be3d-97b1-47ad-8786-027a64aca1ae tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:39.335968 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-38c2be3d-97b1-47ad-8786-027a64aca1ae tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:39.336466 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-38c2be3d-97b1-47ad-8786-027a64aca1ae tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:39.336895 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-38c2be3d-97b1-47ad-8786-027a64aca1ae tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:39.488704 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-38c2be3d-97b1-47ad-8786-027a64aca1ae tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:39.497230 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-38c2be3d-97b1-47ad-8786-027a64aca1ae tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1755 microversion: 2.1 time: 0.174934 Sep 19 12:31:39.497792 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 269/532] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:39 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:40.529566 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c15e9a09-6d75-4fdb-a0f4-6af174fbab5e tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:40.530116 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c15e9a09-6d75-4fdb-a0f4-6af174fbab5e tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:40.536463 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c15e9a09-6d75-4fdb-a0f4-6af174fbab5e tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:40.536965 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c15e9a09-6d75-4fdb-a0f4-6af174fbab5e tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:40.537395 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c15e9a09-6d75-4fdb-a0f4-6af174fbab5e tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:40.538075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c15e9a09-6d75-4fdb-a0f4-6af174fbab5e tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:40.538519 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c15e9a09-6d75-4fdb-a0f4-6af174fbab5e tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:40.538938 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c15e9a09-6d75-4fdb-a0f4-6af174fbab5e tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:40.944066 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c15e9a09-6d75-4fdb-a0f4-6af174fbab5e tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:40.951382 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c15e9a09-6d75-4fdb-a0f4-6af174fbab5e tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1755 microversion: 2.1 time: 0.426288 Sep 19 12:31:40.951958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 264/533] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:40 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1755 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:41.970789 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-545b65a2-ddd3-4559-8639-5282cf944b67 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:41.971387 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-545b65a2-ddd3-4559-8639-5282cf944b67 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:41.975250 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-89144db5-4ec1-485e-917a-0217dd3645f7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:41.975867 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-89144db5-4ec1-485e-917a-0217dd3645f7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:41.977974 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-545b65a2-ddd3-4559-8639-5282cf944b67 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:41.978466 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-545b65a2-ddd3-4559-8639-5282cf944b67 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:41.978897 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-545b65a2-ddd3-4559-8639-5282cf944b67 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:41.979591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-545b65a2-ddd3-4559-8639-5282cf944b67 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:41.980040 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-545b65a2-ddd3-4559-8639-5282cf944b67 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:41.980461 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-545b65a2-ddd3-4559-8639-5282cf944b67 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:41.982072 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-89144db5-4ec1-485e-917a-0217dd3645f7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:41.982559 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-89144db5-4ec1-485e-917a-0217dd3645f7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:41.982992 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-89144db5-4ec1-485e-917a-0217dd3645f7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:41.983685 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-89144db5-4ec1-485e-917a-0217dd3645f7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:41.984167 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-89144db5-4ec1-485e-917a-0217dd3645f7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:41.984592 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-89144db5-4ec1-485e-917a-0217dd3645f7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:42.006939 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-545b65a2-ddd3-4559-8639-5282cf944b67 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Going to try to terminate instance {{(pid=121428) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:31:42.136115 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-89144db5-4ec1-485e-917a-0217dd3645f7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:42.144653 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-89144db5-4ec1-485e-917a-0217dd3645f7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1755 microversion: 2.1 time: 0.173753 Sep 19 12:31:42.147111 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 265/534] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:41 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:31:42.310876 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-545b65a2-ddd3-4559-8639-5282cf944b67 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 204 len: 0 microversion: 2.1 time: 0.343639 Sep 19 12:31:42.311490 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 270/535] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:31:41 2022] DELETE /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:31:42.319589 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-65f6778f-bf92-4454-a869-9df736dc5ac0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:42.320139 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-65f6778f-bf92-4454-a869-9df736dc5ac0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:42.326632 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-65f6778f-bf92-4454-a869-9df736dc5ac0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:42.327116 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-65f6778f-bf92-4454-a869-9df736dc5ac0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:42.327558 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-65f6778f-bf92-4454-a869-9df736dc5ac0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:42.328252 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-65f6778f-bf92-4454-a869-9df736dc5ac0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:42.328730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-65f6778f-bf92-4454-a869-9df736dc5ac0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:42.329155 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-65f6778f-bf92-4454-a869-9df736dc5ac0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:42.458012 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-65f6778f-bf92-4454-a869-9df736dc5ac0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:42.465736 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-65f6778f-bf92-4454-a869-9df736dc5ac0 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1506 microversion: 2.1 time: 0.150124 Sep 19 12:31:42.466315 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 266/536] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:42 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:43.169435 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-4a7e9a4a-ed61-4a49-8b5f-407ebfebc0f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:43.170133 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-4a7e9a4a-ed61-4a49-8b5f-407ebfebc0f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:43.176641 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4a7e9a4a-ed61-4a49-8b5f-407ebfebc0f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:43.177111 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4a7e9a4a-ed61-4a49-8b5f-407ebfebc0f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:43.177542 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4a7e9a4a-ed61-4a49-8b5f-407ebfebc0f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:43.178262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4a7e9a4a-ed61-4a49-8b5f-407ebfebc0f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:43.178698 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4a7e9a4a-ed61-4a49-8b5f-407ebfebc0f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:43.179111 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4a7e9a4a-ed61-4a49-8b5f-407ebfebc0f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:43.322791 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-4a7e9a4a-ed61-4a49-8b5f-407ebfebc0f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:43.331048 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-4a7e9a4a-ed61-4a49-8b5f-407ebfebc0f2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1755 microversion: 2.1 time: 0.166608 Sep 19 12:31:43.331619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 271/537] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:43 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:43.489061 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-dd60feef-3b69-4141-9baa-65f982d7a24c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:43.489665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-dd60feef-3b69-4141-9baa-65f982d7a24c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:43.496337 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dd60feef-3b69-4141-9baa-65f982d7a24c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:43.496872 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dd60feef-3b69-4141-9baa-65f982d7a24c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:43.497351 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dd60feef-3b69-4141-9baa-65f982d7a24c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:43.498050 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dd60feef-3b69-4141-9baa-65f982d7a24c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:43.498504 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dd60feef-3b69-4141-9baa-65f982d7a24c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:43.498927 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dd60feef-3b69-4141-9baa-65f982d7a24c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:43.628232 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-dd60feef-3b69-4141-9baa-65f982d7a24c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:43.636779 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-dd60feef-3b69-4141-9baa-65f982d7a24c tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1506 microversion: 2.1 time: 0.151787 Sep 19 12:31:43.637349 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 267/538] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:43 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:44.355371 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-02a87430-0309-4100-be2a-25d4dbaaf3af tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:44.355972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-02a87430-0309-4100-be2a-25d4dbaaf3af tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:44.362367 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-02a87430-0309-4100-be2a-25d4dbaaf3af tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:44.362839 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-02a87430-0309-4100-be2a-25d4dbaaf3af tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:44.363273 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-02a87430-0309-4100-be2a-25d4dbaaf3af tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:44.363944 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-02a87430-0309-4100-be2a-25d4dbaaf3af tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:44.364385 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-02a87430-0309-4100-be2a-25d4dbaaf3af tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:44.364838 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-02a87430-0309-4100-be2a-25d4dbaaf3af tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:44.503085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-02a87430-0309-4100-be2a-25d4dbaaf3af tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:44.511910 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-02a87430-0309-4100-be2a-25d4dbaaf3af tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1755 microversion: 2.1 time: 0.160391 Sep 19 12:31:44.512484 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 272/539] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:44 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:44.660044 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ad84fc36-ecf2-4a60-859a-38f3294cbd42 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:44.660669 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ad84fc36-ecf2-4a60-859a-38f3294cbd42 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:44.667823 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ad84fc36-ecf2-4a60-859a-38f3294cbd42 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:44.668299 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ad84fc36-ecf2-4a60-859a-38f3294cbd42 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:44.668805 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ad84fc36-ecf2-4a60-859a-38f3294cbd42 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:44.675213 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ad84fc36-ecf2-4a60-859a-38f3294cbd42 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:44.675213 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ad84fc36-ecf2-4a60-859a-38f3294cbd42 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:44.675213 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ad84fc36-ecf2-4a60-859a-38f3294cbd42 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:44.803164 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ad84fc36-ecf2-4a60-859a-38f3294cbd42 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:44.811015 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ad84fc36-ecf2-4a60-859a-38f3294cbd42 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1506 microversion: 2.1 time: 0.154963 Sep 19 12:31:44.811576 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 268/540] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:44 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:44.947535 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-adc3b76d-1bfa-47c3-a8db-614c5024531e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:44.948021 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-adc3b76d-1bfa-47c3-a8db-614c5024531e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:44.953864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-adc3b76d-1bfa-47c3-a8db-614c5024531e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:44.954335 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-adc3b76d-1bfa-47c3-a8db-614c5024531e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:44.954759 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-adc3b76d-1bfa-47c3-a8db-614c5024531e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:44.955427 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-adc3b76d-1bfa-47c3-a8db-614c5024531e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:44.955867 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-adc3b76d-1bfa-47c3-a8db-614c5024531e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:44.956281 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-adc3b76d-1bfa-47c3-a8db-614c5024531e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:44.982868 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-adc3b76d-1bfa-47c3-a8db-614c5024531e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13/ips" status: 200 len: 149 microversion: 2.1 time: 0.095652 Sep 19 12:31:44.983464 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 273/541] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Sep 19 12:31:44 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13/ips => generated 149 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:31:45.536347 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-630da1cc-9276-4755-a366-57265f533ce7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:45.537415 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-630da1cc-9276-4755-a366-57265f533ce7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:45.547552 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-630da1cc-9276-4755-a366-57265f533ce7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:45.548204 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-630da1cc-9276-4755-a366-57265f533ce7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:45.548679 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-630da1cc-9276-4755-a366-57265f533ce7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:45.549370 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-630da1cc-9276-4755-a366-57265f533ce7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:45.549906 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-630da1cc-9276-4755-a366-57265f533ce7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:45.550214 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-630da1cc-9276-4755-a366-57265f533ce7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:45.598245 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-29a05e23-0dd7-41b1-b310-66f32bbc0c08 req-7a17f7ec-84d0-45e0-a8e5-c097c59be9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3ee0aa-80a4-4587-a3dc-c9f654af3edc", "name": "network-vif-deleted", "tag": "407a25f0-769d-4a17-9669-56cf43a8cdc3"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:31:45.611898 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-29a05e23-0dd7-41b1-b310-66f32bbc0c08 req-7a17f7ec-84d0-45e0-a8e5-c097c59be9b5 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:45.612403 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-29a05e23-0dd7-41b1-b310-66f32bbc0c08 req-7a17f7ec-84d0-45e0-a8e5-c097c59be9b5 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:45.613175 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-29a05e23-0dd7-41b1-b310-66f32bbc0c08 req-7a17f7ec-84d0-45e0-a8e5-c097c59be9b5 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:45.628370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-29a05e23-0dd7-41b1-b310-66f32bbc0c08 req-7a17f7ec-84d0-45e0-a8e5-c097c59be9b5 service nova] Creating event network-vif-deleted:407a25f0-769d-4a17-9669-56cf43a8cdc3 for instance 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc on hv-cinder-85061 Sep 19 12:31:45.633576 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-29a05e23-0dd7-41b1-b310-66f32bbc0c08 req-7a17f7ec-84d0-45e0-a8e5-c097c59be9b5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122552 Sep 19 12:31:45.635383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 269/542] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:31:45.735112 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-630da1cc-9276-4755-a366-57265f533ce7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:45.745482 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-630da1cc-9276-4755-a366-57265f533ce7 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1755 microversion: 2.1 time: 0.213927 Sep 19 12:31:45.746066 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 274/543] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:45 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1755 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:45.835838 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b1b5c455-047d-4178-be23-6a9a7ed69013 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:45.836557 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b1b5c455-047d-4178-be23-6a9a7ed69013 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:45.844171 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b1b5c455-047d-4178-be23-6a9a7ed69013 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:45.844738 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b1b5c455-047d-4178-be23-6a9a7ed69013 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:45.845180 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b1b5c455-047d-4178-be23-6a9a7ed69013 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:45.846159 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b1b5c455-047d-4178-be23-6a9a7ed69013 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:45.846623 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b1b5c455-047d-4178-be23-6a9a7ed69013 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:45.847065 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b1b5c455-047d-4178-be23-6a9a7ed69013 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:45.881380 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b1b5c455-047d-4178-be23-6a9a7ed69013 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:45.881875 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b1b5c455-047d-4178-be23-6a9a7ed69013 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:45.882311 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b1b5c455-047d-4178-be23-6a9a7ed69013 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:45.882769 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.objects.instance [None req-b1b5c455-047d-4178-be23-6a9a7ed69013 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lazy-loading 'fault' on Instance uuid 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc {{(pid=121429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:31:45.927993 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-b1b5c455-047d-4178-be23-6a9a7ed69013 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:45.936290 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-b1b5c455-047d-4178-be23-6a9a7ed69013 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 200 len: 1311 microversion: 2.1 time: 0.105180 Sep 19 12:31:45.936914 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 270/544] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:45 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:46.601795 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-814a54f2-373c-43ed-91c9-dc88ca470bc1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "889859f8-bb70-4592-a85f-ef8a767ee040"}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:31:46.603978 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-814a54f2-373c-43ed-91c9-dc88ca470bc1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:46.612160 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-814a54f2-373c-43ed-91c9-dc88ca470bc1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:46.612765 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-814a54f2-373c-43ed-91c9-dc88ca470bc1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:46.613426 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-814a54f2-373c-43ed-91c9-dc88ca470bc1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:46.614127 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-814a54f2-373c-43ed-91c9-dc88ca470bc1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:46.614570 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-814a54f2-373c-43ed-91c9-dc88ca470bc1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:46.615324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-814a54f2-373c-43ed-91c9-dc88ca470bc1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:46.691340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:31:46.771172 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-eb702dc4-34ac-40d2-b6e2-9702f6e72587 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:46.772015 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-eb702dc4-34ac-40d2-b6e2-9702f6e72587 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:46.778279 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-eb702dc4-34ac-40d2-b6e2-9702f6e72587 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:46.778764 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-eb702dc4-34ac-40d2-b6e2-9702f6e72587 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:46.779205 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-eb702dc4-34ac-40d2-b6e2-9702f6e72587 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:46.779934 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-eb702dc4-34ac-40d2-b6e2-9702f6e72587 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:46.780525 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-eb702dc4-34ac-40d2-b6e2-9702f6e72587 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:46.780916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-eb702dc4-34ac-40d2-b6e2-9702f6e72587 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:46.785270 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:31:46.933446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-eb702dc4-34ac-40d2-b6e2-9702f6e72587 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:46.940376 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-eb702dc4-34ac-40d2-b6e2-9702f6e72587 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1755 microversion: 2.1 time: 0.173699 Sep 19 12:31:46.940920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 271/545] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:46 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:31:46.963299 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9252e7c7-21b4-408d-a140-88c3fd6bd21d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:46.963299 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9252e7c7-21b4-408d-a140-88c3fd6bd21d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:46.967388 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9252e7c7-21b4-408d-a140-88c3fd6bd21d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:46.967873 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9252e7c7-21b4-408d-a140-88c3fd6bd21d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:46.968312 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9252e7c7-21b4-408d-a140-88c3fd6bd21d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:46.969043 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9252e7c7-21b4-408d-a140-88c3fd6bd21d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:46.969506 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9252e7c7-21b4-408d-a140-88c3fd6bd21d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:46.969959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9252e7c7-21b4-408d-a140-88c3fd6bd21d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:46.985894 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-9252e7c7-21b4-408d-a140-88c3fd6bd21d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] HTTP exception thrown: Instance 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc could not be found. Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9252e7c7-21b4-408d-a140-88c3fd6bd21d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Request method failure captured: Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc HTTP/1.1 Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKF_tWWphb1JAPvN-EIEQSK52IRz3n-JW79g8MyFMBDW4gW63g8tf-8d7IlXyjaWL-wltQwHjjhVXyF95eo-sDcZPzinRtVOt-jy7eoPO5RoogsMqWYA2aauMqxMNdK7rALFC559OD52R_2prEh0aku1gmbjxDr3u7abPo2C0r5Yj86w Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: b4cb72be6f7d411fbfd037aebc273cb2 Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1257684246 Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:31:46.990947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:31:46.992338 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4cb72be6f7d411fbfd037aebc273cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b4cb72be6f7d411fbfd037aebc273cb2", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4cb72be6f7d411fbfd037aebc273cb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b4cb72be6f7d411fbfd037aebc273cb2"}]}] Sep 19 12:31:46.992338 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1257684246 Sep 19 12:31:46.992338 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: b4cb72be6f7d411fbfd037aebc273cb2 Sep 19 12:31:46.992338 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1257684246 Sep 19 12:31:46.992338 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-ServerRescueNegativeTestJSON-1257684246-project Sep 19 12:31:46.992338 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:31:46.992338 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:31:46.992338 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 90ec87808ac641329bc1491d1b5473d9 Sep 19 12:31:46.992338 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1257684246-project Sep 19 12:31:46.992338 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:31:46.992338 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc could not be found. Sep 19 12:31:46.992338 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': '9c3ee0aa-80a4-4587-a3dc-c9f654af3edc'} Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc could not be found. Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:31:46.993169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:31:46.994477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:31:46.994477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:31:46.994477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:31:46.994477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:31:46.994477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:31:46.994477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:31:46.994477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:31:46.994477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc could not be found. Sep 19 12:31:46.994477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:31:46.994477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:31:46.994477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:31:46.994477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:31:46.994477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:31:46.994477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:31:46.994477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:31:46.994477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:31:46.994477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc could not be found. Sep 19 12:31:46.994477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:31:46.995819 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9252e7c7-21b4-408d-a140-88c3fd6bd21d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Returning 404 to user: Instance 9c3ee0aa-80a4-4587-a3dc-c9f654af3edc could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:31:46.995819 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9252e7c7-21b4-408d-a140-88c3fd6bd21d tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc" status: 404 len: 111 microversion: 2.1 time: 0.032818 Sep 19 12:31:46.995819 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 272/546] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:46 2022] GET /compute/v2.1/servers/9c3ee0aa-80a4-4587-a3dc-c9f654af3edc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 12:31:46.998979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3c81180b-641b-41e4-8aea-86776cb0b3bf tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:46.999499 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3c81180b-641b-41e4-8aea-86776cb0b3bf tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:47.005488 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3c81180b-641b-41e4-8aea-86776cb0b3bf tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:47.005974 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3c81180b-641b-41e4-8aea-86776cb0b3bf tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:47.006413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3c81180b-641b-41e4-8aea-86776cb0b3bf tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:47.007106 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3c81180b-641b-41e4-8aea-86776cb0b3bf tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:47.007556 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3c81180b-641b-41e4-8aea-86776cb0b3bf tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:47.007981 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3c81180b-641b-41e4-8aea-86776cb0b3bf tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:47.033752 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3c81180b-641b-41e4-8aea-86776cb0b3bf tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Going to try to terminate instance {{(pid=121429) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:31:47.434116 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3c81180b-641b-41e4-8aea-86776cb0b3bf tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "DELETE /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 204 len: 0 microversion: 2.1 time: 0.439721 Sep 19 12:31:47.435069 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 273/547] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:31:46 2022] DELETE /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 12:31:47.444672 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-abba138b-4ec5-4beb-a582-69570d3d0e9b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:47.445382 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-abba138b-4ec5-4beb-a582-69570d3d0e9b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:47.453448 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-abba138b-4ec5-4beb-a582-69570d3d0e9b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:47.454138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-abba138b-4ec5-4beb-a582-69570d3d0e9b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:47.454803 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-abba138b-4ec5-4beb-a582-69570d3d0e9b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:47.455604 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-abba138b-4ec5-4beb-a582-69570d3d0e9b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:47.456109 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-abba138b-4ec5-4beb-a582-69570d3d0e9b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:47.456796 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-abba138b-4ec5-4beb-a582-69570d3d0e9b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:47.518603 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-814a54f2-373c-43ed-91c9-dc88ca470bc1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "POST /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.921071 Sep 19 12:31:47.519310 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 275/548] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Sep 19 12:31:46 2022] POST /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13/os-volume_attachments => generated 194 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:31:47.600991 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-abba138b-4ec5-4beb-a582-69570d3d0e9b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:47.609026 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-abba138b-4ec5-4beb-a582-69570d3d0e9b tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.169262 Sep 19 12:31:47.609596 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 274/549] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:47 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:31:47.970277 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-04ccd9e5-8c05-4011-917e-a7c37f44ff96 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:47.970960 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-04ccd9e5-8c05-4011-917e-a7c37f44ff96 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:47.977236 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-04ccd9e5-8c05-4011-917e-a7c37f44ff96 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:47.977714 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-04ccd9e5-8c05-4011-917e-a7c37f44ff96 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:47.978627 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-04ccd9e5-8c05-4011-917e-a7c37f44ff96 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:47.979390 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-04ccd9e5-8c05-4011-917e-a7c37f44ff96 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:47.979749 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-04ccd9e5-8c05-4011-917e-a7c37f44ff96 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:47.980258 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-04ccd9e5-8c05-4011-917e-a7c37f44ff96 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:48.124261 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-04ccd9e5-8c05-4011-917e-a7c37f44ff96 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:48.132776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-04ccd9e5-8c05-4011-917e-a7c37f44ff96 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1755 microversion: 2.1 time: 0.167063 Sep 19 12:31:48.133356 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 276/550] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:47 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:48.632943 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9d5f49aa-6f95-4ed7-b0f5-0912aef5b753 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:48.633758 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9d5f49aa-6f95-4ed7-b0f5-0912aef5b753 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:48.640852 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9d5f49aa-6f95-4ed7-b0f5-0912aef5b753 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:48.641337 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9d5f49aa-6f95-4ed7-b0f5-0912aef5b753 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:48.641778 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9d5f49aa-6f95-4ed7-b0f5-0912aef5b753 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:48.642481 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9d5f49aa-6f95-4ed7-b0f5-0912aef5b753 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:48.642926 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9d5f49aa-6f95-4ed7-b0f5-0912aef5b753 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:48.643349 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9d5f49aa-6f95-4ed7-b0f5-0912aef5b753 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:48.783763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9d5f49aa-6f95-4ed7-b0f5-0912aef5b753 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:48.791398 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9d5f49aa-6f95-4ed7-b0f5-0912aef5b753 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.162558 Sep 19 12:31:48.791959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 275/551] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:48 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:31:49.156706 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-3a28a057-b95f-4de4-a67d-506b5136a596 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:49.157320 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-3a28a057-b95f-4de4-a67d-506b5136a596 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:49.164066 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3a28a057-b95f-4de4-a67d-506b5136a596 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:49.164549 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3a28a057-b95f-4de4-a67d-506b5136a596 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:49.165034 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3a28a057-b95f-4de4-a67d-506b5136a596 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:49.166369 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3a28a057-b95f-4de4-a67d-506b5136a596 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:49.166820 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3a28a057-b95f-4de4-a67d-506b5136a596 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:49.167240 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3a28a057-b95f-4de4-a67d-506b5136a596 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:49.317728 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-3a28a057-b95f-4de4-a67d-506b5136a596 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:49.326123 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-3a28a057-b95f-4de4-a67d-506b5136a596 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1755 microversion: 2.1 time: 0.173206 Sep 19 12:31:49.326700 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 277/552] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:49 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:49.814484 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-8f7ba560-2b9d-4ad1-ba5d-3e370f351b62 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:49.815091 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-8f7ba560-2b9d-4ad1-ba5d-3e370f351b62 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:49.822139 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8f7ba560-2b9d-4ad1-ba5d-3e370f351b62 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:49.822645 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8f7ba560-2b9d-4ad1-ba5d-3e370f351b62 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:49.823064 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8f7ba560-2b9d-4ad1-ba5d-3e370f351b62 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:49.823759 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8f7ba560-2b9d-4ad1-ba5d-3e370f351b62 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:49.824202 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8f7ba560-2b9d-4ad1-ba5d-3e370f351b62 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:49.824651 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8f7ba560-2b9d-4ad1-ba5d-3e370f351b62 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:49.958808 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8f7ba560-2b9d-4ad1-ba5d-3e370f351b62 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:49.966711 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-8f7ba560-2b9d-4ad1-ba5d-3e370f351b62 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.156073 Sep 19 12:31:49.967297 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 276/553] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:49 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:31:50.349751 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-2f099c40-3705-41d3-a0ad-b48ecef38552 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:50.350357 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-2f099c40-3705-41d3-a0ad-b48ecef38552 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:50.357749 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f099c40-3705-41d3-a0ad-b48ecef38552 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:50.358220 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f099c40-3705-41d3-a0ad-b48ecef38552 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:50.358647 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f099c40-3705-41d3-a0ad-b48ecef38552 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:50.359336 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f099c40-3705-41d3-a0ad-b48ecef38552 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:50.359777 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f099c40-3705-41d3-a0ad-b48ecef38552 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:50.360189 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f099c40-3705-41d3-a0ad-b48ecef38552 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:50.506559 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2f099c40-3705-41d3-a0ad-b48ecef38552 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:50.515311 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-2f099c40-3705-41d3-a0ad-b48ecef38552 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1755 microversion: 2.1 time: 0.169353 Sep 19 12:31:50.515884 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 278/554] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:50 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:50.990043 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-06c26f98-0387-4466-8237-0babe090d7e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:50.990613 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-06c26f98-0387-4466-8237-0babe090d7e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:50.996980 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-06c26f98-0387-4466-8237-0babe090d7e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:50.997461 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-06c26f98-0387-4466-8237-0babe090d7e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:50.997890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-06c26f98-0387-4466-8237-0babe090d7e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:50.998586 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-06c26f98-0387-4466-8237-0babe090d7e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:50.999032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-06c26f98-0387-4466-8237-0babe090d7e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:50.999450 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-06c26f98-0387-4466-8237-0babe090d7e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:51.142874 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-06c26f98-0387-4466-8237-0babe090d7e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:51.151497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-06c26f98-0387-4466-8237-0babe090d7e2 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1520 microversion: 2.1 time: 0.165348 Sep 19 12:31:51.152533 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 277/555] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:50 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:51.538730 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-3229231a-6a0b-461d-8e11-cde7c7b2540c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:51.539303 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-3229231a-6a0b-461d-8e11-cde7c7b2540c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:51.546148 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3229231a-6a0b-461d-8e11-cde7c7b2540c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:51.547471 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3229231a-6a0b-461d-8e11-cde7c7b2540c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:51.547471 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3229231a-6a0b-461d-8e11-cde7c7b2540c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:51.548710 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3229231a-6a0b-461d-8e11-cde7c7b2540c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:51.549188 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3229231a-6a0b-461d-8e11-cde7c7b2540c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:51.549619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3229231a-6a0b-461d-8e11-cde7c7b2540c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:51.773605 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-40a60dc2-7b91-427e-b99e-2ffaa58afe50 req-c774fbdf-59f0-491e-b4b9-9c3b6818d4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0ab2f3-883e-4b45-95d1-d0f8895fc401", "name": "network-vif-deleted", "tag": "bfac18c5-608d-4385-8ac9-7abf25bb62fe"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:31:51.784262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-40a60dc2-7b91-427e-b99e-2ffaa58afe50 req-c774fbdf-59f0-491e-b4b9-9c3b6818d4cd service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:51.785145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-40a60dc2-7b91-427e-b99e-2ffaa58afe50 req-c774fbdf-59f0-491e-b4b9-9c3b6818d4cd service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:51.785609 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-40a60dc2-7b91-427e-b99e-2ffaa58afe50 req-c774fbdf-59f0-491e-b4b9-9c3b6818d4cd service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:51.787530 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-3229231a-6a0b-461d-8e11-cde7c7b2540c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:51.797791 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-40a60dc2-7b91-427e-b99e-2ffaa58afe50 req-c774fbdf-59f0-491e-b4b9-9c3b6818d4cd service nova] Creating event network-vif-deleted:bfac18c5-608d-4385-8ac9-7abf25bb62fe for instance aa0ab2f3-883e-4b45-95d1-d0f8895fc401 on hv-cinder-85061 Sep 19 12:31:51.801126 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-3229231a-6a0b-461d-8e11-cde7c7b2540c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1755 microversion: 2.1 time: 0.266479 Sep 19 12:31:51.803209 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 279/556] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:51 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1755 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:51.804531 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-40a60dc2-7b91-427e-b99e-2ffaa58afe50 req-c774fbdf-59f0-491e-b4b9-9c3b6818d4cd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033727 Sep 19 12:31:51.805243 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 278/557] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:31:52.177634 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f28f4c35-6910-4d94-b8be-d9fa368021dc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:52.178250 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f28f4c35-6910-4d94-b8be-d9fa368021dc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:52.184654 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f28f4c35-6910-4d94-b8be-d9fa368021dc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:52.185162 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f28f4c35-6910-4d94-b8be-d9fa368021dc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:52.185601 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f28f4c35-6910-4d94-b8be-d9fa368021dc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:52.188952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f28f4c35-6910-4d94-b8be-d9fa368021dc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:52.188952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f28f4c35-6910-4d94-b8be-d9fa368021dc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:52.188952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f28f4c35-6910-4d94-b8be-d9fa368021dc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:52.222289 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f28f4c35-6910-4d94-b8be-d9fa368021dc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:52.222913 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f28f4c35-6910-4d94-b8be-d9fa368021dc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:52.223541 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f28f4c35-6910-4d94-b8be-d9fa368021dc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:52.223998 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-f28f4c35-6910-4d94-b8be-d9fa368021dc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lazy-loading 'fault' on Instance uuid aa0ab2f3-883e-4b45-95d1-d0f8895fc401 {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:31:52.275302 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f28f4c35-6910-4d94-b8be-d9fa368021dc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ec87808ac641329bc1491d1b5473d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cb72be6f7d411fbfd037aebc273cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:52.287037 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f28f4c35-6910-4d94-b8be-d9fa368021dc tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 200 len: 1311 microversion: 2.1 time: 0.113159 Sep 19 12:31:52.287747 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 280/558] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:52 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:52.834411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c8c1b68c-cf74-4102-8f17-5b24771c01d8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:52.835108 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c8c1b68c-cf74-4102-8f17-5b24771c01d8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:52.843017 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c8c1b68c-cf74-4102-8f17-5b24771c01d8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:52.843513 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c8c1b68c-cf74-4102-8f17-5b24771c01d8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:52.844386 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c8c1b68c-cf74-4102-8f17-5b24771c01d8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:52.844687 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c8c1b68c-cf74-4102-8f17-5b24771c01d8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:52.845197 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c8c1b68c-cf74-4102-8f17-5b24771c01d8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:52.845557 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c8c1b68c-cf74-4102-8f17-5b24771c01d8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:52.992404 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c8c1b68c-cf74-4102-8f17-5b24771c01d8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:53.001184 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c8c1b68c-cf74-4102-8f17-5b24771c01d8 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1755 microversion: 2.1 time: 0.170934 Sep 19 12:31:53.001762 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 279/559] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:52 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:53.311311 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-549a816d-29a7-48d9-82f6-aa3a18869c04 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:53.311909 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-549a816d-29a7-48d9-82f6-aa3a18869c04 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] [instance: aa0ab2f3-883e-4b45-95d1-d0f8895fc401] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:53.318517 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-549a816d-29a7-48d9-82f6-aa3a18869c04 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:53.319025 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-549a816d-29a7-48d9-82f6-aa3a18869c04 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:53.319447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-549a816d-29a7-48d9-82f6-aa3a18869c04 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:53.320133 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-549a816d-29a7-48d9-82f6-aa3a18869c04 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:53.320572 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-549a816d-29a7-48d9-82f6-aa3a18869c04 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:53.321014 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-549a816d-29a7-48d9-82f6-aa3a18869c04 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:53.335885 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-549a816d-29a7-48d9-82f6-aa3a18869c04 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] HTTP exception thrown: Instance aa0ab2f3-883e-4b45-95d1-d0f8895fc401 could not be found. Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-549a816d-29a7-48d9-82f6-aa3a18869c04 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Request method failure captured: Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 HTTP/1.1 Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKF_tWWphb1JAPvN-EIEQSK52IRz3n-JW79g8MyFMBDW4gW63g8tf-8d7IlXyjaWL-wltQwHjjhVXyF95eo-sDcZPzinRtVOt-jy7eoPO5RoogsMqWYA2aauMqxMNdK7rALFC559OD52R_2prEh0aku1gmbjxDr3u7abPo2C0r5Yj86w Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: b4cb72be6f7d411fbfd037aebc273cb2 Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1257684246 Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:31:53.338219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:31:53.340792 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4cb72be6f7d411fbfd037aebc273cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b4cb72be6f7d411fbfd037aebc273cb2", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4cb72be6f7d411fbfd037aebc273cb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b4cb72be6f7d411fbfd037aebc273cb2"}]}] Sep 19 12:31:53.340792 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1257684246 Sep 19 12:31:53.340792 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: b4cb72be6f7d411fbfd037aebc273cb2 Sep 19 12:31:53.340792 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1257684246 Sep 19 12:31:53.340792 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-ServerRescueNegativeTestJSON-1257684246-project Sep 19 12:31:53.340792 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:31:53.340792 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:31:53.340792 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: 90ec87808ac641329bc1491d1b5473d9 Sep 19 12:31:53.340792 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1257684246-project Sep 19 12:31:53.340792 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:31:53.340792 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance aa0ab2f3-883e-4b45-95d1-d0f8895fc401 could not be found. Sep 19 12:31:53.340792 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': 'aa0ab2f3-883e-4b45-95d1-d0f8895fc401'} Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa0ab2f3-883e-4b45-95d1-d0f8895fc401 could not be found. Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:31:53.342172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:31:53.344503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:31:53.344503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:31:53.344503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:31:53.344503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:31:53.344503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:31:53.344503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:31:53.344503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:31:53.344503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa0ab2f3-883e-4b45-95d1-d0f8895fc401 could not be found. Sep 19 12:31:53.344503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:31:53.344503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:31:53.344503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:31:53.344503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:31:53.344503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:31:53.344503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:31:53.344503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:31:53.344503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:31:53.344503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa0ab2f3-883e-4b45-95d1-d0f8895fc401 could not be found. Sep 19 12:31:53.344503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:31:53.346531 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-549a816d-29a7-48d9-82f6-aa3a18869c04 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] Returning 404 to user: Instance aa0ab2f3-883e-4b45-95d1-d0f8895fc401 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:31:53.346531 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-549a816d-29a7-48d9-82f6-aa3a18869c04 tempest-ServerRescueNegativeTestJSON-1257684246 tempest-ServerRescueNegativeTestJSON-1257684246-project] 10.222.0.93 "GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401" status: 404 len: 111 microversion: 2.1 time: 0.032192 Sep 19 12:31:53.346531 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 281/560] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:53 2022] GET /compute/v2.1/servers/aa0ab2f3-883e-4b45-95d1-d0f8895fc401 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:31:54.025593 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-07277123-bb04-4ad1-9401-77269540e2c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:54.026228 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-07277123-bb04-4ad1-9401-77269540e2c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:54.032687 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-07277123-bb04-4ad1-9401-77269540e2c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:54.033164 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-07277123-bb04-4ad1-9401-77269540e2c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:54.033592 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-07277123-bb04-4ad1-9401-77269540e2c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:54.034288 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-07277123-bb04-4ad1-9401-77269540e2c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:54.034730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-07277123-bb04-4ad1-9401-77269540e2c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:54.035145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-07277123-bb04-4ad1-9401-77269540e2c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:54.279184 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-07277123-bb04-4ad1-9401-77269540e2c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:54.287667 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-07277123-bb04-4ad1-9401-77269540e2c5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1755 microversion: 2.1 time: 0.266555 Sep 19 12:31:54.288274 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 280/561] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:54 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1755 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:55.311103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c19c4a87-ff4f-41d9-a02a-6b574c5e2440 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:55.312339 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c19c4a87-ff4f-41d9-a02a-6b574c5e2440 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:55.318997 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c19c4a87-ff4f-41d9-a02a-6b574c5e2440 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:55.319468 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c19c4a87-ff4f-41d9-a02a-6b574c5e2440 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:55.319905 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c19c4a87-ff4f-41d9-a02a-6b574c5e2440 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:55.320582 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c19c4a87-ff4f-41d9-a02a-6b574c5e2440 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:55.321092 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c19c4a87-ff4f-41d9-a02a-6b574c5e2440 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:55.322292 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c19c4a87-ff4f-41d9-a02a-6b574c5e2440 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:55.484819 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c19c4a87-ff4f-41d9-a02a-6b574c5e2440 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:55.494759 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c19c4a87-ff4f-41d9-a02a-6b574c5e2440 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1755 microversion: 2.1 time: 0.187363 Sep 19 12:31:55.495462 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 282/562] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:55 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:56.520691 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9a0ff7d8-64ba-49fc-93ef-cfd37871bfc2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:56.521333 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9a0ff7d8-64ba-49fc-93ef-cfd37871bfc2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:56.530986 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9a0ff7d8-64ba-49fc-93ef-cfd37871bfc2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:56.532350 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9a0ff7d8-64ba-49fc-93ef-cfd37871bfc2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:56.532860 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9a0ff7d8-64ba-49fc-93ef-cfd37871bfc2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:56.533700 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9a0ff7d8-64ba-49fc-93ef-cfd37871bfc2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:56.534215 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9a0ff7d8-64ba-49fc-93ef-cfd37871bfc2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:56.534648 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9a0ff7d8-64ba-49fc-93ef-cfd37871bfc2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:56.736065 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9a0ff7d8-64ba-49fc-93ef-cfd37871bfc2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:56.746515 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9a0ff7d8-64ba-49fc-93ef-cfd37871bfc2 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1755 microversion: 2.1 time: 0.231284 Sep 19 12:31:56.747757 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 281/563] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:56 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1755 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:57.776190 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-44e53ea1-d567-4ac3-8d6c-b9450ea7511b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:57.776847 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-44e53ea1-d567-4ac3-8d6c-b9450ea7511b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:57.784007 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-44e53ea1-d567-4ac3-8d6c-b9450ea7511b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:57.784723 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-44e53ea1-d567-4ac3-8d6c-b9450ea7511b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:57.785158 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-44e53ea1-d567-4ac3-8d6c-b9450ea7511b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:57.785862 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-44e53ea1-d567-4ac3-8d6c-b9450ea7511b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:57.786315 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-44e53ea1-d567-4ac3-8d6c-b9450ea7511b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:57.786734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-44e53ea1-d567-4ac3-8d6c-b9450ea7511b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:57.975193 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-44e53ea1-d567-4ac3-8d6c-b9450ea7511b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:57.984979 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-44e53ea1-d567-4ac3-8d6c-b9450ea7511b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1758 microversion: 2.1 time: 0.213432 Sep 19 12:31:57.986722 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 283/564] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:31:57 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1758 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:31:58.286245 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9d8c59d5-cc0d-4cea-b123-76ad32a115da tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "889859f8-bb70-4592-a85f-ef8a767ee040"}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:31:58.288671 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9d8c59d5-cc0d-4cea-b123-76ad32a115da tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:58.295954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9d8c59d5-cc0d-4cea-b123-76ad32a115da tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:58.296751 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9d8c59d5-cc0d-4cea-b123-76ad32a115da tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:58.297384 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9d8c59d5-cc0d-4cea-b123-76ad32a115da tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:58.298098 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9d8c59d5-cc0d-4cea-b123-76ad32a115da tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:58.298554 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9d8c59d5-cc0d-4cea-b123-76ad32a115da tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:58.298980 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9d8c59d5-cc0d-4cea-b123-76ad32a115da tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:58.393249 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-9d8c59d5-cc0d-4cea-b123-76ad32a115da tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] HTTP exception thrown: Invalid volume: volume 889859f8-bb70-4592-a85f-ef8a767ee040 is already attached to instances: 50dff3e8-23ae-4501-b36a-35a1b3629b13 Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9d8c59d5-cc0d-4cea-b123-76ad32a115da tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Request method failure captured: Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: POST /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13/os-volume_attachments HTTP/1.1 Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 74 Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKF_xba_JzZBCLNYzS-MR7i3MH3BmQnGBrtpnxxJ02XYU-aLwAMxUp37Js2oVsjZH1Xi2UqEV1PX4cz9KrfQYP2FUn0P4VJxchdxu1X2bfyWUsNGE-kHp0diwIJQq10d4xyW6w1vIK1PG2u4EnZQQclxeJyL0DgqKkwpL098U-5D5sHs Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:31:58.395041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:31:58.396675 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_68496d9aa29542139f00104051248a5b", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/68496d9aa29542139f00104051248a5b"}]}] Sep 19 12:31:58.396675 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:31:58.396675 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:31:58.396675 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:31:58.396675 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:31:58.396675 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:31:58.396675 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:31:58.396675 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 3a48e0ab477f43d294607d441af0b444 Sep 19 12:31:58.396675 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:31:58.396675 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Sep 19 12:31:58.396675 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {"volumeAttachment": {"volumeId": "889859f8-bb70-4592-a85f-ef8a767ee040"}} Sep 19 12:31:58.396675 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:31:58.397568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Invalid volume: volume 889859f8-bb70-4592-a85f-ef8a767ee040 is already attached to instances: 50dff3e8-23ae-4501-b36a-35a1b3629b13 Sep 19 12:31:58.397568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'server_id': '50dff3e8-23ae-4501-b36a-35a1b3629b13', 'body': {'volumeAttachment': {'volumeId': '889859f8-bb70-4592-a85f-ef8a767ee040'}}} Sep 19 12:31:58.397568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:31:58.397568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:31:58.397568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 12:31:58.397568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 12:31:58.397568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 12:31:58.397568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 12:31:58.397568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 12:31:58.397568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 12:31:58.397568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 19 12:31:58.397568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 19 12:31:58.397568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 19 12:31:58.397568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 19 12:31:58.397568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 889859f8-bb70-4592-a85f-ef8a767ee040 is already attached to instances: 50dff3e8-23ae-4501-b36a-35a1b3629b13 Sep 19 12:31:58.397568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:31:58.397568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:31:58.397568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:31:58.397568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 889859f8-bb70-4592-a85f-ef8a767ee040 is already attached to instances: 50dff3e8-23ae-4501-b36a-35a1b3629b13 Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:31:58.398890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:31:58.400578 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:31:58.400578 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:31:58.400578 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:31:58.400578 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 889859f8-bb70-4592-a85f-ef8a767ee040 is already attached to instances: 50dff3e8-23ae-4501-b36a-35a1b3629b13 Sep 19 12:31:58.400578 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:31:58.400578 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9d8c59d5-cc0d-4cea-b123-76ad32a115da tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Returning 400 to user: Invalid volume: volume 889859f8-bb70-4592-a85f-ef8a767ee040 is already attached to instances: 50dff3e8-23ae-4501-b36a-35a1b3629b13 {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:31:58.400578 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9d8c59d5-cc0d-4cea-b123-76ad32a115da tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "POST /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114284 Sep 19 12:31:58.400578 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 282/565] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Sep 19 12:31:58 2022] POST /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:31:58.469489 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a4aaadea-78ed-4812-833a-2c0eebd351b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:58.469489 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a4aaadea-78ed-4812-833a-2c0eebd351b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:58.475562 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a4aaadea-78ed-4812-833a-2c0eebd351b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:58.476051 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a4aaadea-78ed-4812-833a-2c0eebd351b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:58.476534 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a4aaadea-78ed-4812-833a-2c0eebd351b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:58.477284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a4aaadea-78ed-4812-833a-2c0eebd351b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:58.477786 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a4aaadea-78ed-4812-833a-2c0eebd351b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:58.478209 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a4aaadea-78ed-4812-833a-2c0eebd351b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:58.564631 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-a4aaadea-78ed-4812-833a-2c0eebd351b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lazy-loading 'services' on Instance uuid 50dff3e8-23ae-4501-b36a-35a1b3629b13 {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:31:58.852766 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a4aaadea-78ed-4812-833a-2c0eebd351b7 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "DELETE /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13/os-volume_attachments/889859f8-bb70-4592-a85f-ef8a767ee040" status: 202 len: 0 microversion: 2.1 time: 0.388034 Sep 19 12:31:58.853429 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 284/566] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Sep 19 12:31:58 2022] DELETE /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13/os-volume_attachments/889859f8-bb70-4592-a85f-ef8a767ee040 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:31:58.861852 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5dc188b2-cf09-4013-b696-2e63d4de1c06 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:58.864103 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-5dc188b2-cf09-4013-b696-2e63d4de1c06 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:58.870181 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:31:58.876265 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5dc188b2-cf09-4013-b696-2e63d4de1c06 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:58.876791 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5dc188b2-cf09-4013-b696-2e63d4de1c06 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:58.877228 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5dc188b2-cf09-4013-b696-2e63d4de1c06 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:58.877929 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5dc188b2-cf09-4013-b696-2e63d4de1c06 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:58.878379 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5dc188b2-cf09-4013-b696-2e63d4de1c06 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:58.878818 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5dc188b2-cf09-4013-b696-2e63d4de1c06 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:58.912683 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5dc188b2-cf09-4013-b696-2e63d4de1c06 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054730 Sep 19 12:31:58.913261 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 283/567] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Sep 19 12:31:58 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:31:59.927334 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-dd24ddc9-550e-45f4-8717-c2ab92ec9492 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:59.929775 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-dd24ddc9-550e-45f4-8717-c2ab92ec9492 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:59.936681 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dd24ddc9-550e-45f4-8717-c2ab92ec9492 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:59.937707 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dd24ddc9-550e-45f4-8717-c2ab92ec9492 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:59.938409 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dd24ddc9-550e-45f4-8717-c2ab92ec9492 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:59.939327 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dd24ddc9-550e-45f4-8717-c2ab92ec9492 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:59.939895 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dd24ddc9-550e-45f4-8717-c2ab92ec9492 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:59.940419 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dd24ddc9-550e-45f4-8717-c2ab92ec9492 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:59.973496 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-dd24ddc9-550e-45f4-8717-c2ab92ec9492 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052101 Sep 19 12:31:59.974406 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 285/568] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Sep 19 12:31:59 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:32:00.987197 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-0644d26e-76be-404a-a3ad-a153185572a3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:00.989337 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-0644d26e-76be-404a-a3ad-a153185572a3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:00.996735 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0644d26e-76be-404a-a3ad-a153185572a3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:00.997502 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0644d26e-76be-404a-a3ad-a153185572a3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:01.002874 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0644d26e-76be-404a-a3ad-a153185572a3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:01.002874 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0644d26e-76be-404a-a3ad-a153185572a3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:01.002874 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0644d26e-76be-404a-a3ad-a153185572a3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:01.002874 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0644d26e-76be-404a-a3ad-a153185572a3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:01.031247 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-0644d26e-76be-404a-a3ad-a153185572a3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048667 Sep 19 12:32:01.032008 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 284/569] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Sep 19 12:32:00 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 12:32:01.100974 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a0fec25b-5944-4dbf-a0ce-93153094ff50 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:01.101541 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a0fec25b-5944-4dbf-a0ce-93153094ff50 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:01.109838 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a0fec25b-5944-4dbf-a0ce-93153094ff50 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:01.110576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a0fec25b-5944-4dbf-a0ce-93153094ff50 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:01.111207 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a0fec25b-5944-4dbf-a0ce-93153094ff50 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:01.112118 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a0fec25b-5944-4dbf-a0ce-93153094ff50 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:01.112743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a0fec25b-5944-4dbf-a0ce-93153094ff50 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:01.113315 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a0fec25b-5944-4dbf-a0ce-93153094ff50 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:01.142641 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a0fec25b-5944-4dbf-a0ce-93153094ff50 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Going to try to terminate instance {{(pid=121428) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:32:01.448489 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a0fec25b-5944-4dbf-a0ce-93153094ff50 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "DELETE /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 204 len: 0 microversion: 2.1 time: 0.351196 Sep 19 12:32:01.449597 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 286/570] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:32:01 2022] DELETE /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:32:01.458395 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-168a33b1-db90-402a-a6c6-44b8c8221cac tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:01.459421 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-168a33b1-db90-402a-a6c6-44b8c8221cac tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:01.466762 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-168a33b1-db90-402a-a6c6-44b8c8221cac tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:01.467399 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-168a33b1-db90-402a-a6c6-44b8c8221cac tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:01.468113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-168a33b1-db90-402a-a6c6-44b8c8221cac tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:01.469544 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-168a33b1-db90-402a-a6c6-44b8c8221cac tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:01.470229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-168a33b1-db90-402a-a6c6-44b8c8221cac tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:01.471029 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-168a33b1-db90-402a-a6c6-44b8c8221cac tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:01.683547 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-168a33b1-db90-402a-a6c6-44b8c8221cac tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:01.695199 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-168a33b1-db90-402a-a6c6-44b8c8221cac tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1682 microversion: 2.1 time: 0.240456 Sep 19 12:32:01.711482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 285/571] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:01 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1682 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:02.732745 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-be9b516e-4eb6-4529-87af-32b7ff204107 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:02.733454 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-be9b516e-4eb6-4529-87af-32b7ff204107 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:02.735909 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:02.741761 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-be9b516e-4eb6-4529-87af-32b7ff204107 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:02.742246 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-be9b516e-4eb6-4529-87af-32b7ff204107 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:02.742691 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-be9b516e-4eb6-4529-87af-32b7ff204107 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:02.743378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-be9b516e-4eb6-4529-87af-32b7ff204107 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:02.743827 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-be9b516e-4eb6-4529-87af-32b7ff204107 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:02.744251 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-be9b516e-4eb6-4529-87af-32b7ff204107 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:02.917166 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-be9b516e-4eb6-4529-87af-32b7ff204107 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:02.925284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-be9b516e-4eb6-4529-87af-32b7ff204107 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1682 microversion: 2.1 time: 0.196751 Sep 19 12:32:02.925857 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 287/572] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:02 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1682 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:03.953277 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5088fa14-7803-4304-a754-2a989348fb74 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:03.954781 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-5088fa14-7803-4304-a754-2a989348fb74 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:03.963822 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5088fa14-7803-4304-a754-2a989348fb74 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:03.965089 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5088fa14-7803-4304-a754-2a989348fb74 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:03.965820 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5088fa14-7803-4304-a754-2a989348fb74 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:03.966855 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5088fa14-7803-4304-a754-2a989348fb74 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:03.967423 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5088fa14-7803-4304-a754-2a989348fb74 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:03.968046 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5088fa14-7803-4304-a754-2a989348fb74 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:04.213544 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-5088fa14-7803-4304-a754-2a989348fb74 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:04.223738 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5088fa14-7803-4304-a754-2a989348fb74 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1682 microversion: 2.1 time: 0.275461 Sep 19 12:32:04.224417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 286/573] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:03 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1682 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:04.596897 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-746c7fd1-ac74-4215-87d8-bcadb7415717 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:04.596897 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-746c7fd1-ac74-4215-87d8-bcadb7415717 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:04.605681 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-746c7fd1-ac74-4215-87d8-bcadb7415717 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:04.606435 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-746c7fd1-ac74-4215-87d8-bcadb7415717 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:04.607059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-746c7fd1-ac74-4215-87d8-bcadb7415717 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:04.607980 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-746c7fd1-ac74-4215-87d8-bcadb7415717 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:04.610312 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-746c7fd1-ac74-4215-87d8-bcadb7415717 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:04.611229 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-746c7fd1-ac74-4215-87d8-bcadb7415717 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:04.647727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-746c7fd1-ac74-4215-87d8-bcadb7415717 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/ips" status: 200 len: 144 microversion: 2.1 time: 0.333879 Sep 19 12:32:04.648881 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 288/574] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Sep 19 12:32:04 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/ips => generated 144 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:05.231703 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-1aeb8a29-2e78-4694-8911-3408edca0cbc req-02b8850e-d434-4bf6-9646-18cc7373f394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50dff3e8-23ae-4501-b36a-35a1b3629b13", "name": "network-vif-deleted", "tag": "5979e202-897a-4341-9c8c-f0e2c941d24d"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:05.255152 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c6e18fc4-20fb-4999-912e-9a3d4d4857c9 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:05.257417 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c6e18fc4-20fb-4999-912e-9a3d4d4857c9 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:05.276776 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-1aeb8a29-2e78-4694-8911-3408edca0cbc req-02b8850e-d434-4bf6-9646-18cc7373f394 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:05.279409 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-1aeb8a29-2e78-4694-8911-3408edca0cbc req-02b8850e-d434-4bf6-9646-18cc7373f394 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:05.281811 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-1aeb8a29-2e78-4694-8911-3408edca0cbc req-02b8850e-d434-4bf6-9646-18cc7373f394 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:05.286528 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c6e18fc4-20fb-4999-912e-9a3d4d4857c9 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:05.289830 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c6e18fc4-20fb-4999-912e-9a3d4d4857c9 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:05.293311 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c6e18fc4-20fb-4999-912e-9a3d4d4857c9 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:05.295406 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c6e18fc4-20fb-4999-912e-9a3d4d4857c9 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:05.299254 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c6e18fc4-20fb-4999-912e-9a3d4d4857c9 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:05.303278 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c6e18fc4-20fb-4999-912e-9a3d4d4857c9 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:05.304159 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-1aeb8a29-2e78-4694-8911-3408edca0cbc req-02b8850e-d434-4bf6-9646-18cc7373f394 service nova] Creating event network-vif-deleted:5979e202-897a-4341-9c8c-f0e2c941d24d for instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 on hv-cinder-85061 Sep 19 12:32:05.313310 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-1aeb8a29-2e78-4694-8911-3408edca0cbc req-02b8850e-d434-4bf6-9646-18cc7373f394 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090352 Sep 19 12:32:05.313919 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 287/575] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:05.327208 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:05.453995 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c6e18fc4-20fb-4999-912e-9a3d4d4857c9 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:05.478691 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c6e18fc4-20fb-4999-912e-9a3d4d4857c9 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1614 microversion: 2.1 time: 0.230729 Sep 19 12:32:05.481010 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 289/576] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:05 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1614 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:06.116312 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-062dc3ad-4079-4c79-98e7-24ce60316497 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Action: 'create', calling method: .version_select at 0x7f54b36891f0>, body: {"keypair": {"name": "tempest-keypair-1216363609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNv/ecNFznCLnW5SEPaP1bkCpthZkVqor6VJMsJldhf7YbSrTHVj9NC7gr/UNRkQE+rBxcCyznlHe2Qm2/CNrTKiuMvnjJWNCbxlXHc1V+Fnbs4VWdcJ+6Ir1k0cDjbOWQ=="}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:06.133792 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-062dc3ad-4079-4c79-98e7-24ce60316497 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Getting quotas for project 6316917c9ff94be4bed47eb0b60e7f33. Resources: {'key_pairs'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:32:06.138799 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-062dc3ad-4079-4c79-98e7-24ce60316497 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Getting quotas for user c6f743b2ff4246d98700f57efedfcea2 and project 6316917c9ff94be4bed47eb0b60e7f33. Resources: {'key_pairs'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:32:06.232247 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-062dc3ad-4079-4c79-98e7-24ce60316497 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.179656 Sep 19 12:32:06.234656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 288/577] 10.222.0.93 () {62 vars in 1200 bytes} [Mon Sep 19 12:32:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 182 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 12:32:06.483374 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-5081efe8-a257-4ebc-bbc4-ba32d6b80dd3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "969357ec-f8f2-4da8-8186-e846d62d49b4"}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:06.485925 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-5081efe8-a257-4ebc-bbc4-ba32d6b80dd3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:06.493311 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5081efe8-a257-4ebc-bbc4-ba32d6b80dd3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:06.493935 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5081efe8-a257-4ebc-bbc4-ba32d6b80dd3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:06.494469 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5081efe8-a257-4ebc-bbc4-ba32d6b80dd3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:06.495231 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5081efe8-a257-4ebc-bbc4-ba32d6b80dd3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:06.495895 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5081efe8-a257-4ebc-bbc4-ba32d6b80dd3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:06.496324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5081efe8-a257-4ebc-bbc4-ba32d6b80dd3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:06.508593 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-21dccb74-69f1-4293-8c3d-192bd4b9a364 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:06.509725 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-21dccb74-69f1-4293-8c3d-192bd4b9a364 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:06.528465 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-21dccb74-69f1-4293-8c3d-192bd4b9a364 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:06.529427 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-21dccb74-69f1-4293-8c3d-192bd4b9a364 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:06.530470 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-21dccb74-69f1-4293-8c3d-192bd4b9a364 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:06.531720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-21dccb74-69f1-4293-8c3d-192bd4b9a364 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:06.532418 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-21dccb74-69f1-4293-8c3d-192bd4b9a364 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:06.535010 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-21dccb74-69f1-4293-8c3d-192bd4b9a364 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:06.541439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:06.578544 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-21dccb74-69f1-4293-8c3d-192bd4b9a364 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:06.579039 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-21dccb74-69f1-4293-8c3d-192bd4b9a364 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:06.579493 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-21dccb74-69f1-4293-8c3d-192bd4b9a364 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:06.579958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.objects.instance [None req-21dccb74-69f1-4293-8c3d-192bd4b9a364 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lazy-loading 'fault' on Instance uuid 50dff3e8-23ae-4501-b36a-35a1b3629b13 {{(pid=121429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:32:06.626651 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-21dccb74-69f1-4293-8c3d-192bd4b9a364 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:06.637237 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-21dccb74-69f1-4293-8c3d-192bd4b9a364 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 200 len: 1332 microversion: 2.1 time: 0.132876 Sep 19 12:32:06.639473 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 289/578] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:06 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 1332 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:07.417347 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-5081efe8-a257-4ebc-bbc4-ba32d6b80dd3 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "POST /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.937711 Sep 19 12:32:07.417956 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 290/579] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Sep 19 12:32:06 2022] POST /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments => generated 194 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:07.678076 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-a0df558b-fb77-425e-8b9a-9a47592d2953 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:07.678833 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-a0df558b-fb77-425e-8b9a-9a47592d2953 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:07.687268 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a0df558b-fb77-425e-8b9a-9a47592d2953 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:07.688654 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a0df558b-fb77-425e-8b9a-9a47592d2953 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:07.689319 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a0df558b-fb77-425e-8b9a-9a47592d2953 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:07.690041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a0df558b-fb77-425e-8b9a-9a47592d2953 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:07.690499 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a0df558b-fb77-425e-8b9a-9a47592d2953 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:07.691113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a0df558b-fb77-425e-8b9a-9a47592d2953 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:07.706561 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-a0df558b-fb77-425e-8b9a-9a47592d2953 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] HTTP exception thrown: Instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 could not be found. Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-a0df558b-fb77-425e-8b9a-9a47592d2953 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Request method failure captured: Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 HTTP/1.1 Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKF_xba_JzZBCLNYzS-MR7i3MH3BmQnGBrtpnxxJ02XYU-aLwAMxUp37Js2oVsjZH1Xi2UqEV1PX4cz9KrfQYP2FUn0P4VJxchdxu1X2bfyWUsNGE-kHp0diwIJQq10d4xyW6w1vIK1PG2u4EnZQQclxeJyL0DgqKkwpL098U-5D5sHs Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:32:07.708343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:32:07.709721 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_68496d9aa29542139f00104051248a5b", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/68496d9aa29542139f00104051248a5b"}]}] Sep 19 12:32:07.709721 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:32:07.709721 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:32:07.709721 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:32:07.709721 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:32:07.709721 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:32:07.709721 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:32:07.709721 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 3a48e0ab477f43d294607d441af0b444 Sep 19 12:32:07.709721 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:32:07.709721 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:32:07.709721 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 could not be found. Sep 19 12:32:07.709721 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': '50dff3e8-23ae-4501-b36a-35a1b3629b13'} Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 could not be found. Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:32:07.710455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:32:07.712140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:32:07.712140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:32:07.712140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:32:07.712140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:32:07.712140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:32:07.712140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:32:07.712140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:32:07.712140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 could not be found. Sep 19 12:32:07.712140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:07.712140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:07.712140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:07.712140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:07.712140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:07.712140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:07.712140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:32:07.712140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:32:07.712140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 could not be found. Sep 19 12:32:07.712140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:07.715424 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-a0df558b-fb77-425e-8b9a-9a47592d2953 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Returning 404 to user: Instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:32:07.715424 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-a0df558b-fb77-425e-8b9a-9a47592d2953 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 404 len: 111 microversion: 2.1 time: 0.037070 Sep 19 12:32:07.715424 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 290/580] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:07 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 12:32:07.721118 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-011af481-9dd4-431f-8826-92abcd1b93d4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '.version_select at 0x7f54b35799d0>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:07.823998 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-011af481-9dd4-431f-8826-92abcd1b93d4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1942085181" status: 202 len: 0 microversion: 2.1 time: 0.105400 Sep 19 12:32:07.824650 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 291/581] 10.222.0.93 () {58 vars in 1221 bytes} [Mon Sep 19 12:32:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1942085181 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:32:08.791136 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9ea33617-ee96-45d6-bef2-49900c232f54 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1388631838", "imageRef": "d4301833-8e96-46bf-a940-692f93f7fdba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af5272e5-f954-494b-ac83-7c8776b2b4cb"}], "security_groups": [{"name": "tempest-securitygroup--2119416457"}], "key_name": "tempest-keypair-1216363609", "user_data": "}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:08.863407 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-bb34fb7b-ae25-478b-a9cd-6420705110cf tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Action: 'create', calling method: .version_select at 0x7f54b34e8790>, body: {"keypair": {"name": "tempest-keypair-341852389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCnc1XUFR3nLqNAFZqBwlmx1O4xacx0512KwMG64Y+oobFCtdTEpR64Bd9V+EITZoLn+u84Ok229BdNIhe8qCLpbu9xK4Mog2NYNisyCwOl+HX9GBYfW8QKNgWmj7sMkw=="}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:08.880707 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-bb34fb7b-ae25-478b-a9cd-6420705110cf tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Getting quotas for project 68496d9aa29542139f00104051248a5b. Resources: {'key_pairs'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:32:08.885732 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-bb34fb7b-ae25-478b-a9cd-6420705110cf tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Getting quotas for user 3a48e0ab477f43d294607d441af0b444 and project 68496d9aa29542139f00104051248a5b. Resources: {'key_pairs'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:32:08.912208 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.network.neutron [None req-9ea33617-ee96-45d6-bef2-49900c232f54 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] validate_networks() for [('af5272e5-f954-494b-ac83-7c8776b2b4cb', None, None, None, None, None)] {{(pid=121429) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:32:08.968958 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-bb34fb7b-ae25-478b-a9cd-6420705110cf tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.110183 Sep 19 12:32:08.970225 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 292/582] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Sep 19 12:32:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:32:09.399460 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-9ea33617-ee96-45d6-bef2-49900c232f54 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Flavor limits 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:32:09.399891 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-9ea33617-ee96-45d6-bef2-49900c232f54 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Image limits 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:32:09.400399 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-9ea33617-ee96-45d6-bef2-49900c232f54 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Flavor pref 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:32:09.400809 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-9ea33617-ee96-45d6-bef2-49900c232f54 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Image pref 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:32:09.401241 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-9ea33617-ee96-45d6-bef2-49900c232f54 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:32:09.415494 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9ea33617-ee96-45d6-bef2-49900c232f54 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:09.415494 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9ea33617-ee96-45d6-bef2-49900c232f54 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:09.415494 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9ea33617-ee96-45d6-bef2-49900c232f54 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:09.415494 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9ea33617-ee96-45d6-bef2-49900c232f54 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:09.416282 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9ea33617-ee96-45d6-bef2-49900c232f54 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:09.416282 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9ea33617-ee96-45d6-bef2-49900c232f54 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:09.431238 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-9ea33617-ee96-45d6-bef2-49900c232f54 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Getting quotas for project 6316917c9ff94be4bed47eb0b60e7f33. Resources: {'instances', 'ram', 'cores'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:32:09.435556 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-9ea33617-ee96-45d6-bef2-49900c232f54 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Getting quotas for user c6f743b2ff4246d98700f57efedfcea2 and project 6316917c9ff94be4bed47eb0b60e7f33. Resources: {'instances', 'ram', 'cores'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:32:09.450193 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9ea33617-ee96-45d6-bef2-49900c232f54 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Going to run 1 instances... {{(pid=121429) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:32:09.452775 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9ea33617-ee96-45d6-bef2-49900c232f54 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4301833-8e96-46bf-a940-692f93f7fdba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121429) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:32:09.676248 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9ea33617-ee96-45d6-bef2-49900c232f54 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.892646 Sep 19 12:32:09.684857 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 291/583] 10.222.0.93 () {62 vars in 1188 bytes} [Mon Sep 19 12:32:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 12:32:09.694533 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8b2075f8-c735-40ac-81c2-beeb3226be73 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:09.695336 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-8b2075f8-c735-40ac-81c2-beeb3226be73 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:09.759049 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-8b2075f8-c735-40ac-81c2-beeb3226be73 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:09.775659 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-8b2075f8-c735-40ac-81c2-beeb3226be73 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:09.775659 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-8b2075f8-c735-40ac-81c2-beeb3226be73 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:09.776389 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8b2075f8-c735-40ac-81c2-beeb3226be73 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1282 microversion: 2.20 time: 0.086262 Sep 19 12:32:09.777337 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 293/584] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:32:09 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1282 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:32:10.803218 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-719245c7-2cad-49fd-97b3-913bf72318bb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:10.803932 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-719245c7-2cad-49fd-97b3-913bf72318bb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:10.866914 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-719245c7-2cad-49fd-97b3-913bf72318bb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:10.876525 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-719245c7-2cad-49fd-97b3-913bf72318bb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:10.878151 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-719245c7-2cad-49fd-97b3-913bf72318bb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:10.879848 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-719245c7-2cad-49fd-97b3-913bf72318bb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1282 microversion: 2.20 time: 0.080790 Sep 19 12:32:10.880396 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 292/585] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:32:10 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1282 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:32:11.703606 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e378617c-480b-486d-bde2-91c928da5bf4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1021074064", "imageRef": "d4301833-8e96-46bf-a940-692f93f7fdba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2775bc2c-1de6-4530-99c8-74593487735c"}], "security_groups": [{"name": "tempest-securitygroup--370576965"}], "key_name": "tempest-keypair-341852389", "user_data": "}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:11.816184 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.network.neutron [None req-e378617c-480b-486d-bde2-91c928da5bf4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] validate_networks() for [('2775bc2c-1de6-4530-99c8-74593487735c', None, None, None, None, None)] {{(pid=121428) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:32:11.906062 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b3e95392-643d-405b-bf27-350fb2f90225 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:11.906872 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b3e95392-643d-405b-bf27-350fb2f90225 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:11.913663 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b3e95392-643d-405b-bf27-350fb2f90225 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:11.914154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b3e95392-643d-405b-bf27-350fb2f90225 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:11.914659 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b3e95392-643d-405b-bf27-350fb2f90225 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:11.915368 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b3e95392-643d-405b-bf27-350fb2f90225 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:11.915827 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b3e95392-643d-405b-bf27-350fb2f90225 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:11.916254 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b3e95392-643d-405b-bf27-350fb2f90225 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:11.987098 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-b3e95392-643d-405b-bf27-350fb2f90225 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:11.995995 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-b3e95392-643d-405b-bf27-350fb2f90225 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:11.997478 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-b3e95392-643d-405b-bf27-350fb2f90225 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:11.998578 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-b3e95392-643d-405b-bf27-350fb2f90225 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1334 microversion: 2.20 time: 0.096569 Sep 19 12:32:11.999324 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 293/586] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:32:11 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1334 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:32:12.260655 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-e378617c-480b-486d-bde2-91c928da5bf4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Flavor limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:32:12.261078 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-e378617c-480b-486d-bde2-91c928da5bf4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Image limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:32:12.261587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-e378617c-480b-486d-bde2-91c928da5bf4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Flavor pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:32:12.261989 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-e378617c-480b-486d-bde2-91c928da5bf4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Image pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:32:12.262392 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-e378617c-480b-486d-bde2-91c928da5bf4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:32:12.274661 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e378617c-480b-486d-bde2-91c928da5bf4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:12.275495 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e378617c-480b-486d-bde2-91c928da5bf4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:12.276451 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e378617c-480b-486d-bde2-91c928da5bf4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:12.281974 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e378617c-480b-486d-bde2-91c928da5bf4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:12.281974 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e378617c-480b-486d-bde2-91c928da5bf4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:12.281974 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e378617c-480b-486d-bde2-91c928da5bf4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:12.309691 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-e378617c-480b-486d-bde2-91c928da5bf4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Getting quotas for project 68496d9aa29542139f00104051248a5b. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:32:12.316210 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-e378617c-480b-486d-bde2-91c928da5bf4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Getting quotas for user 3a48e0ab477f43d294607d441af0b444 and project 68496d9aa29542139f00104051248a5b. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:32:12.334903 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e378617c-480b-486d-bde2-91c928da5bf4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Going to run 1 instances... {{(pid=121428) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:32:12.339845 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e378617c-480b-486d-bde2-91c928da5bf4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4301833-8e96-46bf-a940-692f93f7fdba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:32:12.612970 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e378617c-480b-486d-bde2-91c928da5bf4 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.846576 Sep 19 12:32:12.612970 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 294/587] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:32:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:32:12.614309 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ab34151a-b74a-495d-b798-144ac5dbaac1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:12.614309 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ab34151a-b74a-495d-b798-144ac5dbaac1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:12.631264 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ab34151a-b74a-495d-b798-144ac5dbaac1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:12.638735 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ab34151a-b74a-495d-b798-144ac5dbaac1 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 200 len: 1241 microversion: 2.1 time: 0.080489 Sep 19 12:32:12.639286 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 294/588] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:12 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:13.024944 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-3f4ef4ca-d32b-472c-be6d-449e3382b887 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:13.025532 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-3f4ef4ca-d32b-472c-be6d-449e3382b887 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:13.032549 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3f4ef4ca-d32b-472c-be6d-449e3382b887 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:13.033146 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3f4ef4ca-d32b-472c-be6d-449e3382b887 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:13.033578 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3f4ef4ca-d32b-472c-be6d-449e3382b887 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:13.034263 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3f4ef4ca-d32b-472c-be6d-449e3382b887 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:13.034708 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3f4ef4ca-d32b-472c-be6d-449e3382b887 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:13.035124 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3f4ef4ca-d32b-472c-be6d-449e3382b887 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:13.105660 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-3f4ef4ca-d32b-472c-be6d-449e3382b887 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:13.114595 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-3f4ef4ca-d32b-472c-be6d-449e3382b887 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:13.115866 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-3f4ef4ca-d32b-472c-be6d-449e3382b887 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:13.117148 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-3f4ef4ca-d32b-472c-be6d-449e3382b887 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1340 microversion: 2.20 time: 0.097452 Sep 19 12:32:13.118237 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 295/589] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:32:13 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1340 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:32:13.666153 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-a8ddef5b-7903-4810-bbdc-43322de92b91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:13.666879 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-a8ddef5b-7903-4810-bbdc-43322de92b91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:13.674584 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a8ddef5b-7903-4810-bbdc-43322de92b91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:13.674950 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a8ddef5b-7903-4810-bbdc-43322de92b91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:13.675397 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a8ddef5b-7903-4810-bbdc-43322de92b91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:13.676116 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a8ddef5b-7903-4810-bbdc-43322de92b91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:13.676636 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a8ddef5b-7903-4810-bbdc-43322de92b91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:13.677074 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a8ddef5b-7903-4810-bbdc-43322de92b91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:13.767229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-a8ddef5b-7903-4810-bbdc-43322de92b91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:13.782687 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-a8ddef5b-7903-4810-bbdc-43322de92b91 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 200 len: 1245 microversion: 2.1 time: 0.120015 Sep 19 12:32:13.783765 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 295/590] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:13 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 1245 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:14.144692 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-fab607a3-a018-4da5-8964-6791c791b79d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:14.145340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-fab607a3-a018-4da5-8964-6791c791b79d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:14.152809 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fab607a3-a018-4da5-8964-6791c791b79d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:14.153397 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fab607a3-a018-4da5-8964-6791c791b79d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:14.154027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fab607a3-a018-4da5-8964-6791c791b79d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:14.154755 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fab607a3-a018-4da5-8964-6791c791b79d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:14.155202 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fab607a3-a018-4da5-8964-6791c791b79d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:14.155621 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fab607a3-a018-4da5-8964-6791c791b79d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:14.265024 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-25158679-5dff-42d7-bbc3-0db89d410807 req-09bc1015-2689-4053-91e8-faad40135893 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c5331a8-de67-49e9-a0f6-96c8a1915492", "tag": "760b99b4-defc-4bbb-86a7-39ce573ef1d4"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:14.275666 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-25158679-5dff-42d7-bbc3-0db89d410807 req-09bc1015-2689-4053-91e8-faad40135893 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:14.276376 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-25158679-5dff-42d7-bbc3-0db89d410807 req-09bc1015-2689-4053-91e8-faad40135893 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:14.277622 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-25158679-5dff-42d7-bbc3-0db89d410807 req-09bc1015-2689-4053-91e8-faad40135893 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:14.292873 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-25158679-5dff-42d7-bbc3-0db89d410807 req-09bc1015-2689-4053-91e8-faad40135893 service nova] Creating event network-changed:760b99b4-defc-4bbb-86a7-39ce573ef1d4 for instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 on hv-cinder-85061 Sep 19 12:32:14.298776 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-25158679-5dff-42d7-bbc3-0db89d410807 req-09bc1015-2689-4053-91e8-faad40135893 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037362 Sep 19 12:32:14.300064 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 296/591] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:32:14.393525 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-fab607a3-a018-4da5-8964-6791c791b79d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:14.403098 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-fab607a3-a018-4da5-8964-6791c791b79d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:14.404559 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-fab607a3-a018-4da5-8964-6791c791b79d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:14.405711 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-fab607a3-a018-4da5-8964-6791c791b79d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1408 microversion: 2.20 time: 0.265156 Sep 19 12:32:14.406264 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 296/592] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:32:14 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:32:14.807769 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-7b502776-4449-45a4-9ded-6db387017a2d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:14.808473 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-7b502776-4449-45a4-9ded-6db387017a2d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:14.815273 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7b502776-4449-45a4-9ded-6db387017a2d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:14.815797 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7b502776-4449-45a4-9ded-6db387017a2d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:14.816203 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7b502776-4449-45a4-9ded-6db387017a2d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:14.816949 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7b502776-4449-45a4-9ded-6db387017a2d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:14.817401 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7b502776-4449-45a4-9ded-6db387017a2d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:14.817828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7b502776-4449-45a4-9ded-6db387017a2d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:14.894251 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-7b502776-4449-45a4-9ded-6db387017a2d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:14.902628 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-7b502776-4449-45a4-9ded-6db387017a2d tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 200 len: 1293 microversion: 2.1 time: 0.100139 Sep 19 12:32:14.903233 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 297/593] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:14 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 1293 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:15.112306 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-005747c1-aa59-46a1-9bfd-932b792ed1d8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:15.120787 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-005747c1-aa59-46a1-9bfd-932b792ed1d8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:15.123885 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-005747c1-aa59-46a1-9bfd-932b792ed1d8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:15.124587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-005747c1-aa59-46a1-9bfd-932b792ed1d8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:15.125131 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-005747c1-aa59-46a1-9bfd-932b792ed1d8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:15.125962 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-005747c1-aa59-46a1-9bfd-932b792ed1d8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:15.126487 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-005747c1-aa59-46a1-9bfd-932b792ed1d8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:15.126983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-005747c1-aa59-46a1-9bfd-932b792ed1d8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:15.166703 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-005747c1-aa59-46a1-9bfd-932b792ed1d8 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058300 Sep 19 12:32:15.167655 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 297/594] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Sep 19 12:32:15 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:15.178317 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5376ac2b-b61b-4f42-97fa-ca16255739a9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:15.178751 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-5376ac2b-b61b-4f42-97fa-ca16255739a9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:15.186030 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5376ac2b-b61b-4f42-97fa-ca16255739a9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:15.186524 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5376ac2b-b61b-4f42-97fa-ca16255739a9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:15.186961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5376ac2b-b61b-4f42-97fa-ca16255739a9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:15.187678 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5376ac2b-b61b-4f42-97fa-ca16255739a9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:15.188127 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5376ac2b-b61b-4f42-97fa-ca16255739a9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:15.188555 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5376ac2b-b61b-4f42-97fa-ca16255739a9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:15.222475 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5376ac2b-b61b-4f42-97fa-ca16255739a9 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments/969357ec-f8f2-4da8-8186-e846d62d49b4" status: 200 len: 194 microversion: 2.1 time: 0.048281 Sep 19 12:32:15.223093 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 298/595] 10.222.0.93 () {58 vars in 1413 bytes} [Mon Sep 19 12:32:15 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments/969357ec-f8f2-4da8-8186-e846d62d49b4 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:15.452340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-88629b92-ba6f-4792-9887-6d8cf2508afc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:15.453184 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-88629b92-ba6f-4792-9887-6d8cf2508afc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:15.460855 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-88629b92-ba6f-4792-9887-6d8cf2508afc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:15.467148 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-88629b92-ba6f-4792-9887-6d8cf2508afc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:15.467148 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-88629b92-ba6f-4792-9887-6d8cf2508afc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:15.467148 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-88629b92-ba6f-4792-9887-6d8cf2508afc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:15.467148 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-88629b92-ba6f-4792-9887-6d8cf2508afc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:15.467784 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-88629b92-ba6f-4792-9887-6d8cf2508afc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:15.733019 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-88629b92-ba6f-4792-9887-6d8cf2508afc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:15.741776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-88629b92-ba6f-4792-9887-6d8cf2508afc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:15.743251 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-88629b92-ba6f-4792-9887-6d8cf2508afc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:15.744399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-88629b92-ba6f-4792-9887-6d8cf2508afc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1408 microversion: 2.20 time: 0.302554 Sep 19 12:32:15.745167 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 298/596] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:32:15 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1408 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:32:15.927542 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c260b519-94d9-4f4f-9e01-ceac06297b18 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:15.928162 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c260b519-94d9-4f4f-9e01-ceac06297b18 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:15.935075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c260b519-94d9-4f4f-9e01-ceac06297b18 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:15.935616 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c260b519-94d9-4f4f-9e01-ceac06297b18 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:15.936290 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c260b519-94d9-4f4f-9e01-ceac06297b18 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:15.937807 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c260b519-94d9-4f4f-9e01-ceac06297b18 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:15.938506 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c260b519-94d9-4f4f-9e01-ceac06297b18 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:15.948901 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c260b519-94d9-4f4f-9e01-ceac06297b18 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:16.039931 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c260b519-94d9-4f4f-9e01-ceac06297b18 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:16.049813 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c260b519-94d9-4f4f-9e01-ceac06297b18 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 200 len: 1299 microversion: 2.1 time: 0.127173 Sep 19 12:32:16.050399 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 299/597] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:15 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:16.771534 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-5360e8ce-7b4c-4b1a-b9f1-69e046cad181 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:16.772166 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-5360e8ce-7b4c-4b1a-b9f1-69e046cad181 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:16.778744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5360e8ce-7b4c-4b1a-b9f1-69e046cad181 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:16.779219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5360e8ce-7b4c-4b1a-b9f1-69e046cad181 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:16.779647 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5360e8ce-7b4c-4b1a-b9f1-69e046cad181 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:16.780341 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5360e8ce-7b4c-4b1a-b9f1-69e046cad181 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:16.780811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5360e8ce-7b4c-4b1a-b9f1-69e046cad181 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:16.781224 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5360e8ce-7b4c-4b1a-b9f1-69e046cad181 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:16.981157 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5360e8ce-7b4c-4b1a-b9f1-69e046cad181 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:16.990568 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5360e8ce-7b4c-4b1a-b9f1-69e046cad181 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:16.992170 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5360e8ce-7b4c-4b1a-b9f1-69e046cad181 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:16.993605 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-5360e8ce-7b4c-4b1a-b9f1-69e046cad181 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1408 microversion: 2.20 time: 0.226043 Sep 19 12:32:17.006379 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 299/598] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:32:16 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:32:17.042876 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-8021c3ad-626d-4c2d-ba42-fee164ed226a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98dc4b3a-42d9-4218-8108-6f9527101454"}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:17.045270 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-8021c3ad-626d-4c2d-ba42-fee164ed226a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:17.052419 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8021c3ad-626d-4c2d-ba42-fee164ed226a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:17.052938 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8021c3ad-626d-4c2d-ba42-fee164ed226a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:17.053382 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8021c3ad-626d-4c2d-ba42-fee164ed226a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:17.054081 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8021c3ad-626d-4c2d-ba42-fee164ed226a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:17.054519 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8021c3ad-626d-4c2d-ba42-fee164ed226a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:17.055005 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8021c3ad-626d-4c2d-ba42-fee164ed226a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:17.074659 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f32a24a4-8317-463e-8859-4e09aaf083d0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:17.075510 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f32a24a4-8317-463e-8859-4e09aaf083d0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:17.082120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f32a24a4-8317-463e-8859-4e09aaf083d0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:17.082613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f32a24a4-8317-463e-8859-4e09aaf083d0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:17.083049 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f32a24a4-8317-463e-8859-4e09aaf083d0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:17.083760 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f32a24a4-8317-463e-8859-4e09aaf083d0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:17.084206 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f32a24a4-8317-463e-8859-4e09aaf083d0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:17.084880 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f32a24a4-8317-463e-8859-4e09aaf083d0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:17.273701 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f32a24a4-8317-463e-8859-4e09aaf083d0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:17.282589 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f32a24a4-8317-463e-8859-4e09aaf083d0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 200 len: 1366 microversion: 2.1 time: 0.211800 Sep 19 12:32:17.288109 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 300/599] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:17 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:32:17.373258 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-577a116d-637d-4505-83ed-5abe8ee02277 req-149605f7-6bbb-434f-a1e8-b1a8696a2eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a1ebcb8-0086-4004-b180-b8e674649b75", "tag": "3501b95d-b6c9-49f3-9b9e-c60d361550ad"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:17.387268 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-577a116d-637d-4505-83ed-5abe8ee02277 req-149605f7-6bbb-434f-a1e8-b1a8696a2eb1 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:17.387744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-577a116d-637d-4505-83ed-5abe8ee02277 req-149605f7-6bbb-434f-a1e8-b1a8696a2eb1 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:17.388433 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-577a116d-637d-4505-83ed-5abe8ee02277 req-149605f7-6bbb-434f-a1e8-b1a8696a2eb1 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:17.400861 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-577a116d-637d-4505-83ed-5abe8ee02277 req-149605f7-6bbb-434f-a1e8-b1a8696a2eb1 service nova] Creating event network-changed:3501b95d-b6c9-49f3-9b9e-c60d361550ad for instance 7a1ebcb8-0086-4004-b180-b8e674649b75 on hv-cinder-85061 Sep 19 12:32:17.406124 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-577a116d-637d-4505-83ed-5abe8ee02277 req-149605f7-6bbb-434f-a1e8-b1a8696a2eb1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042785 Sep 19 12:32:17.407260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 301/600] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:18.009653 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-8021c3ad-626d-4c2d-ba42-fee164ed226a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "POST /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.971087 Sep 19 12:32:18.010297 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 300/601] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Sep 19 12:32:17 2022] POST /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments => generated 194 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:18.021535 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8bd3bfb8-c267-4d8d-a1f3-c3e277b838be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:18.022671 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-8bd3bfb8-c267-4d8d-a1f3-c3e277b838be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:18.029800 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8bd3bfb8-c267-4d8d-a1f3-c3e277b838be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:18.030442 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8bd3bfb8-c267-4d8d-a1f3-c3e277b838be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:18.030990 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8bd3bfb8-c267-4d8d-a1f3-c3e277b838be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:18.031799 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8bd3bfb8-c267-4d8d-a1f3-c3e277b838be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:18.032350 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8bd3bfb8-c267-4d8d-a1f3-c3e277b838be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:18.032862 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8bd3bfb8-c267-4d8d-a1f3-c3e277b838be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:18.263777 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-8bd3bfb8-c267-4d8d-a1f3-c3e277b838be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:18.278006 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-8bd3bfb8-c267-4d8d-a1f3-c3e277b838be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:18.280068 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-8bd3bfb8-c267-4d8d-a1f3-c3e277b838be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:18.281321 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8bd3bfb8-c267-4d8d-a1f3-c3e277b838be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1408 microversion: 2.20 time: 0.266462 Sep 19 12:32:18.282421 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 302/602] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:32:18 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1408 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:32:18.309452 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b0af23dd-2018-431f-85fb-edf36f857366 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:18.310163 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b0af23dd-2018-431f-85fb-edf36f857366 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:18.324078 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b0af23dd-2018-431f-85fb-edf36f857366 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:18.324575 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b0af23dd-2018-431f-85fb-edf36f857366 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:18.325034 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b0af23dd-2018-431f-85fb-edf36f857366 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:18.325953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b0af23dd-2018-431f-85fb-edf36f857366 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:18.326409 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b0af23dd-2018-431f-85fb-edf36f857366 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:18.326834 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b0af23dd-2018-431f-85fb-edf36f857366 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:18.655637 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-b0af23dd-2018-431f-85fb-edf36f857366 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:18.664091 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-b0af23dd-2018-431f-85fb-edf36f857366 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 200 len: 1366 microversion: 2.1 time: 0.361698 Sep 19 12:32:18.665262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 301/603] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:18 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:32:19.311087 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d82301c4-9381-44ac-88e7-3d602f3d496d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:19.311701 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d82301c4-9381-44ac-88e7-3d602f3d496d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:19.318204 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d82301c4-9381-44ac-88e7-3d602f3d496d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:19.318721 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d82301c4-9381-44ac-88e7-3d602f3d496d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:19.319200 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d82301c4-9381-44ac-88e7-3d602f3d496d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:19.320002 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d82301c4-9381-44ac-88e7-3d602f3d496d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:19.320490 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d82301c4-9381-44ac-88e7-3d602f3d496d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:19.320981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d82301c4-9381-44ac-88e7-3d602f3d496d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:19.464158 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-d82301c4-9381-44ac-88e7-3d602f3d496d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:19.472649 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-d82301c4-9381-44ac-88e7-3d602f3d496d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:19.474109 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-d82301c4-9381-44ac-88e7-3d602f3d496d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:19.475247 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d82301c4-9381-44ac-88e7-3d602f3d496d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1408 microversion: 2.20 time: 0.168088 Sep 19 12:32:19.475814 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 303/604] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:32:19 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:32:19.690092 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-bd608086-bce9-47e9-a409-a45d9f438bf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:19.690653 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-bd608086-bce9-47e9-a409-a45d9f438bf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:19.693135 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=2 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:19.698630 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bd608086-bce9-47e9-a409-a45d9f438bf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:19.699123 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bd608086-bce9-47e9-a409-a45d9f438bf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:19.699563 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bd608086-bce9-47e9-a409-a45d9f438bf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:19.700258 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bd608086-bce9-47e9-a409-a45d9f438bf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:19.700743 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bd608086-bce9-47e9-a409-a45d9f438bf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:19.701168 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bd608086-bce9-47e9-a409-a45d9f438bf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:19.908655 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-bd608086-bce9-47e9-a409-a45d9f438bf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:19.916379 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-bd608086-bce9-47e9-a409-a45d9f438bf8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 200 len: 1366 microversion: 2.1 time: 0.230334 Sep 19 12:32:19.917180 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 302/605] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:19 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:20.503329 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2e153c8e-3855-4672-b338-f49e55d4aa34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:20.503329 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2e153c8e-3855-4672-b338-f49e55d4aa34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:20.507596 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2e153c8e-3855-4672-b338-f49e55d4aa34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:20.508121 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2e153c8e-3855-4672-b338-f49e55d4aa34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:20.508559 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2e153c8e-3855-4672-b338-f49e55d4aa34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:20.509545 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2e153c8e-3855-4672-b338-f49e55d4aa34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:20.509998 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2e153c8e-3855-4672-b338-f49e55d4aa34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:20.510424 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2e153c8e-3855-4672-b338-f49e55d4aa34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:20.559024 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-7607320c-286a-46cc-944b-4e2fcc24d489 req-0b06cc68-665f-4540-8c10-b0af6f768d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c5331a8-de67-49e9-a0f6-96c8a1915492", "name": "network-vif-plugged", "status": "completed", "tag": "760b99b4-defc-4bbb-86a7-39ce573ef1d4"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:20.569700 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-7607320c-286a-46cc-944b-4e2fcc24d489 req-0b06cc68-665f-4540-8c10-b0af6f768d99 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:20.570493 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-7607320c-286a-46cc-944b-4e2fcc24d489 req-0b06cc68-665f-4540-8c10-b0af6f768d99 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:20.570925 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-7607320c-286a-46cc-944b-4e2fcc24d489 req-0b06cc68-665f-4540-8c10-b0af6f768d99 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:20.583137 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-7607320c-286a-46cc-944b-4e2fcc24d489 req-0b06cc68-665f-4540-8c10-b0af6f768d99 service nova] Creating event network-vif-plugged:760b99b4-defc-4bbb-86a7-39ce573ef1d4 for instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 on hv-cinder-85061 Sep 19 12:32:20.589964 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-7607320c-286a-46cc-944b-4e2fcc24d489 req-0b06cc68-665f-4540-8c10-b0af6f768d99 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098183 Sep 19 12:32:20.591137 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 304/606] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:20.673501 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2e153c8e-3855-4672-b338-f49e55d4aa34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:20.683148 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2e153c8e-3855-4672-b338-f49e55d4aa34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:20.684223 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2e153c8e-3855-4672-b338-f49e55d4aa34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:20.685706 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2e153c8e-3855-4672-b338-f49e55d4aa34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1408 microversion: 2.20 time: 0.190046 Sep 19 12:32:20.686826 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 303/607] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:32:20 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:32:20.941175 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d513d862-bf3e-4468-b5b7-b4f372f8afe0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:20.942505 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d513d862-bf3e-4468-b5b7-b4f372f8afe0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:20.951025 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d513d862-bf3e-4468-b5b7-b4f372f8afe0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:20.951548 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d513d862-bf3e-4468-b5b7-b4f372f8afe0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:20.951983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d513d862-bf3e-4468-b5b7-b4f372f8afe0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:20.952709 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d513d862-bf3e-4468-b5b7-b4f372f8afe0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:20.953200 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d513d862-bf3e-4468-b5b7-b4f372f8afe0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:20.953556 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d513d862-bf3e-4468-b5b7-b4f372f8afe0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:21.096488 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-d513d862-bf3e-4468-b5b7-b4f372f8afe0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:21.105070 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d513d862-bf3e-4468-b5b7-b4f372f8afe0 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 200 len: 1366 microversion: 2.1 time: 0.168812 Sep 19 12:32:21.105654 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 305/608] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:20 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:21.712047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c2d12f38-88c6-46cd-8794-94ba31ded3dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:21.712682 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c2d12f38-88c6-46cd-8794-94ba31ded3dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:21.719360 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c2d12f38-88c6-46cd-8794-94ba31ded3dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:21.719847 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c2d12f38-88c6-46cd-8794-94ba31ded3dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:21.720290 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c2d12f38-88c6-46cd-8794-94ba31ded3dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:21.721030 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c2d12f38-88c6-46cd-8794-94ba31ded3dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:21.721481 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c2d12f38-88c6-46cd-8794-94ba31ded3dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:21.721907 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c2d12f38-88c6-46cd-8794-94ba31ded3dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:21.854138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c2d12f38-88c6-46cd-8794-94ba31ded3dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:21.862608 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c2d12f38-88c6-46cd-8794-94ba31ded3dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:21.864093 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c2d12f38-88c6-46cd-8794-94ba31ded3dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:21.865242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c2d12f38-88c6-46cd-8794-94ba31ded3dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1408 microversion: 2.20 time: 0.157852 Sep 19 12:32:21.865800 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 304/609] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:32:21 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:32:22.128420 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b9a833a3-5bd0-4875-8e8d-a102ce6215ea tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:22.129073 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-b9a833a3-5bd0-4875-8e8d-a102ce6215ea tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:22.136475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b9a833a3-5bd0-4875-8e8d-a102ce6215ea tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:22.136984 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b9a833a3-5bd0-4875-8e8d-a102ce6215ea tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:22.137417 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b9a833a3-5bd0-4875-8e8d-a102ce6215ea tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:22.138100 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b9a833a3-5bd0-4875-8e8d-a102ce6215ea tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:22.138547 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b9a833a3-5bd0-4875-8e8d-a102ce6215ea tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:22.138963 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b9a833a3-5bd0-4875-8e8d-a102ce6215ea tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:22.274566 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-b9a833a3-5bd0-4875-8e8d-a102ce6215ea tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:22.287473 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-b9a833a3-5bd0-4875-8e8d-a102ce6215ea tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 200 len: 1366 microversion: 2.1 time: 0.162806 Sep 19 12:32:22.288336 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 306/610] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:22 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:22.605423 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-921903b3-2348-4cb0-8f6f-511ee79ec910 req-35dab6e2-55c9-4dda-87e3-a2f7123ba1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a1ebcb8-0086-4004-b180-b8e674649b75", "name": "network-vif-plugged", "status": "completed", "tag": "3501b95d-b6c9-49f3-9b9e-c60d361550ad"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:22.615129 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-921903b3-2348-4cb0-8f6f-511ee79ec910 req-35dab6e2-55c9-4dda-87e3-a2f7123ba1e4 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:22.615610 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-921903b3-2348-4cb0-8f6f-511ee79ec910 req-35dab6e2-55c9-4dda-87e3-a2f7123ba1e4 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:22.616084 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-921903b3-2348-4cb0-8f6f-511ee79ec910 req-35dab6e2-55c9-4dda-87e3-a2f7123ba1e4 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:22.626877 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-921903b3-2348-4cb0-8f6f-511ee79ec910 req-35dab6e2-55c9-4dda-87e3-a2f7123ba1e4 service nova] Creating event network-vif-plugged:3501b95d-b6c9-49f3-9b9e-c60d361550ad for instance 7a1ebcb8-0086-4004-b180-b8e674649b75 on hv-cinder-85061 Sep 19 12:32:22.631946 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-921903b3-2348-4cb0-8f6f-511ee79ec910 req-35dab6e2-55c9-4dda-87e3-a2f7123ba1e4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030144 Sep 19 12:32:22.632622 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 305/611] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:22.890685 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-945fd8d7-29dd-4c10-a15d-2a4f96fda57f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:22.891195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-945fd8d7-29dd-4c10-a15d-2a4f96fda57f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:22.893153 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=2 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:22.893875 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=12 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:22.898618 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-945fd8d7-29dd-4c10-a15d-2a4f96fda57f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:22.899088 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-945fd8d7-29dd-4c10-a15d-2a4f96fda57f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:22.899516 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-945fd8d7-29dd-4c10-a15d-2a4f96fda57f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:22.900201 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-945fd8d7-29dd-4c10-a15d-2a4f96fda57f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:22.900663 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-945fd8d7-29dd-4c10-a15d-2a4f96fda57f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:22.906471 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-945fd8d7-29dd-4c10-a15d-2a4f96fda57f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:23.031662 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-945fd8d7-29dd-4c10-a15d-2a4f96fda57f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:23.039864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-945fd8d7-29dd-4c10-a15d-2a4f96fda57f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:23.041340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-945fd8d7-29dd-4c10-a15d-2a4f96fda57f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:23.042486 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-945fd8d7-29dd-4c10-a15d-2a4f96fda57f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1600 microversion: 2.20 time: 0.155884 Sep 19 12:32:23.043038 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 307/612] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:32:22 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:32:23.065174 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=14 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:23.070178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-10ce39dc-daf3-4a2c-a586-9b6710553378 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:23.071380 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-10ce39dc-daf3-4a2c-a586-9b6710553378 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:23.077801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-10ce39dc-daf3-4a2c-a586-9b6710553378 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:23.080682 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-10ce39dc-daf3-4a2c-a586-9b6710553378 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:23.080682 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-10ce39dc-daf3-4a2c-a586-9b6710553378 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:23.080682 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-10ce39dc-daf3-4a2c-a586-9b6710553378 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:23.080682 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-10ce39dc-daf3-4a2c-a586-9b6710553378 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:23.081058 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-10ce39dc-daf3-4a2c-a586-9b6710553378 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:23.166033 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-10ce39dc-daf3-4a2c-a586-9b6710553378 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.101773 Sep 19 12:32:23.166673 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 306/613] 10.222.0.93 () {60 vars in 1316 bytes} [Mon Sep 19 12:32:23 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:32:23.310372 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b0627ec1-b2b9-4599-8f60-e393588862e3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:23.311054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-b0627ec1-b2b9-4599-8f60-e393588862e3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:23.317573 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b0627ec1-b2b9-4599-8f60-e393588862e3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:23.318052 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b0627ec1-b2b9-4599-8f60-e393588862e3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:23.318668 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b0627ec1-b2b9-4599-8f60-e393588862e3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:23.319364 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b0627ec1-b2b9-4599-8f60-e393588862e3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:23.319810 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b0627ec1-b2b9-4599-8f60-e393588862e3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:23.320260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b0627ec1-b2b9-4599-8f60-e393588862e3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:23.610818 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-b0627ec1-b2b9-4599-8f60-e393588862e3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:23.618986 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-b0627ec1-b2b9-4599-8f60-e393588862e3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 200 len: 1366 microversion: 2.1 time: 0.312499 Sep 19 12:32:23.619668 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 308/614] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:23 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:24.317993 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-38cda514-2b32-4724-ab32-468f2232978d req-349b22cd-bea6-4463-97b4-725222563123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c5331a8-de67-49e9-a0f6-96c8a1915492", "tag": "760b99b4-defc-4bbb-86a7-39ce573ef1d4"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:24.328207 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-38cda514-2b32-4724-ab32-468f2232978d req-349b22cd-bea6-4463-97b4-725222563123 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:24.328807 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-38cda514-2b32-4724-ab32-468f2232978d req-349b22cd-bea6-4463-97b4-725222563123 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:24.329315 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-38cda514-2b32-4724-ab32-468f2232978d req-349b22cd-bea6-4463-97b4-725222563123 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:24.340248 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-38cda514-2b32-4724-ab32-468f2232978d req-349b22cd-bea6-4463-97b4-725222563123 service nova] Creating event network-changed:760b99b4-defc-4bbb-86a7-39ce573ef1d4 for instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 on hv-cinder-85061 Sep 19 12:32:24.345372 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-38cda514-2b32-4724-ab32-468f2232978d req-349b22cd-bea6-4463-97b4-725222563123 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031874 Sep 19 12:32:24.345963 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 307/615] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:24.642280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d2298b18-bba2-484f-a0a9-f33b3e9a0efb tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:24.642988 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d2298b18-bba2-484f-a0a9-f33b3e9a0efb tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:24.649238 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d2298b18-bba2-484f-a0a9-f33b3e9a0efb tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:24.649713 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d2298b18-bba2-484f-a0a9-f33b3e9a0efb tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:24.650146 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d2298b18-bba2-484f-a0a9-f33b3e9a0efb tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:24.650836 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d2298b18-bba2-484f-a0a9-f33b3e9a0efb tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:24.651282 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d2298b18-bba2-484f-a0a9-f33b3e9a0efb tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:24.651700 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d2298b18-bba2-484f-a0a9-f33b3e9a0efb tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:24.789516 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-d2298b18-bba2-484f-a0a9-f33b3e9a0efb tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:24.791827 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:24.798383 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d2298b18-bba2-484f-a0a9-f33b3e9a0efb tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 200 len: 1366 microversion: 2.1 time: 0.159820 Sep 19 12:32:24.799072 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 309/616] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:24 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:25.822723 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-82aeabed-a30e-492d-9c8c-becdad8ee56a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:25.823451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-82aeabed-a30e-492d-9c8c-becdad8ee56a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:25.830301 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-82aeabed-a30e-492d-9c8c-becdad8ee56a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:25.835535 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-82aeabed-a30e-492d-9c8c-becdad8ee56a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:25.835535 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-82aeabed-a30e-492d-9c8c-becdad8ee56a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:25.835535 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-82aeabed-a30e-492d-9c8c-becdad8ee56a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:25.835535 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-82aeabed-a30e-492d-9c8c-becdad8ee56a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:25.836651 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-82aeabed-a30e-492d-9c8c-becdad8ee56a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:25.959979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-82aeabed-a30e-492d-9c8c-becdad8ee56a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:25.968117 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-82aeabed-a30e-492d-9c8c-becdad8ee56a tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 200 len: 1556 microversion: 2.1 time: 0.149708 Sep 19 12:32:25.968709 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 308/617] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:25 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:25.990608 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-41b7d6c1-330a-442c-bd72-9c61a1bf2c45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:25.991165 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-41b7d6c1-330a-442c-bd72-9c61a1bf2c45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:25.998125 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-41b7d6c1-330a-442c-bd72-9c61a1bf2c45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:25.998609 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-41b7d6c1-330a-442c-bd72-9c61a1bf2c45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:25.999036 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-41b7d6c1-330a-442c-bd72-9c61a1bf2c45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:25.999715 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-41b7d6c1-330a-442c-bd72-9c61a1bf2c45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:26.000157 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-41b7d6c1-330a-442c-bd72-9c61a1bf2c45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:26.000574 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-41b7d6c1-330a-442c-bd72-9c61a1bf2c45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:26.082118 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-41b7d6c1-330a-442c-bd72-9c61a1bf2c45 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095285 Sep 19 12:32:26.082706 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 310/618] 10.222.0.93 () {58 vars in 1275 bytes} [Mon Sep 19 12:32:25 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:27.189222 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-3e939717-0d51-4f6d-b9a3-3e69b18f5c0e req-43cf1813-73c5-41b5-846a-9a9c34519304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a1ebcb8-0086-4004-b180-b8e674649b75", "tag": "3501b95d-b6c9-49f3-9b9e-c60d361550ad"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:27.200523 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-3e939717-0d51-4f6d-b9a3-3e69b18f5c0e req-43cf1813-73c5-41b5-846a-9a9c34519304 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:27.201026 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-3e939717-0d51-4f6d-b9a3-3e69b18f5c0e req-43cf1813-73c5-41b5-846a-9a9c34519304 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:27.201456 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-3e939717-0d51-4f6d-b9a3-3e69b18f5c0e req-43cf1813-73c5-41b5-846a-9a9c34519304 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:27.214258 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-3e939717-0d51-4f6d-b9a3-3e69b18f5c0e req-43cf1813-73c5-41b5-846a-9a9c34519304 service nova] Creating event network-changed:3501b95d-b6c9-49f3-9b9e-c60d361550ad for instance 7a1ebcb8-0086-4004-b180-b8e674649b75 on hv-cinder-85061 Sep 19 12:32:27.219444 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-3e939717-0d51-4f6d-b9a3-3e69b18f5c0e req-43cf1813-73c5-41b5-846a-9a9c34519304 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134262 Sep 19 12:32:27.220255 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 309/619] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:27.739527 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-fc88a486-c3f6-42db-86fc-059d4b0bbd1e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:27.741834 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-fc88a486-c3f6-42db-86fc-059d4b0bbd1e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:27.748283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fc88a486-c3f6-42db-86fc-059d4b0bbd1e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:27.749032 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fc88a486-c3f6-42db-86fc-059d4b0bbd1e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:27.750644 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fc88a486-c3f6-42db-86fc-059d4b0bbd1e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:27.751383 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fc88a486-c3f6-42db-86fc-059d4b0bbd1e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:27.751843 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fc88a486-c3f6-42db-86fc-059d4b0bbd1e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:27.752275 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fc88a486-c3f6-42db-86fc-059d4b0bbd1e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:27.789472 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-fc88a486-c3f6-42db-86fc-059d4b0bbd1e tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054496 Sep 19 12:32:27.795214 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 311/620] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Sep 19 12:32:27 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments => generated 371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:27.950422 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-77188bc0-7d62-41b2-a494-8d6f7ac2b178 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:27.951010 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-77188bc0-7d62-41b2-a494-8d6f7ac2b178 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:27.957523 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-77188bc0-7d62-41b2-a494-8d6f7ac2b178 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:27.958072 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-77188bc0-7d62-41b2-a494-8d6f7ac2b178 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:27.958748 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-77188bc0-7d62-41b2-a494-8d6f7ac2b178 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:27.959461 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-77188bc0-7d62-41b2-a494-8d6f7ac2b178 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:27.960147 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-77188bc0-7d62-41b2-a494-8d6f7ac2b178 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:27.961540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-77188bc0-7d62-41b2-a494-8d6f7ac2b178 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:27.979686 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:27.993367 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-77188bc0-7d62-41b2-a494-8d6f7ac2b178 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments/969357ec-f8f2-4da8-8186-e846d62d49b4" status: 200 len: 194 microversion: 2.1 time: 0.047229 Sep 19 12:32:27.997230 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 310/621] 10.222.0.93 () {58 vars in 1413 bytes} [Mon Sep 19 12:32:27 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments/969357ec-f8f2-4da8-8186-e846d62d49b4 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:28.004899 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d6548a18-1b5f-4840-955c-f16cb201fe2b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:28.005595 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d6548a18-1b5f-4840-955c-f16cb201fe2b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:28.012920 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d6548a18-1b5f-4840-955c-f16cb201fe2b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:28.013505 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d6548a18-1b5f-4840-955c-f16cb201fe2b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:28.013970 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d6548a18-1b5f-4840-955c-f16cb201fe2b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:28.014669 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d6548a18-1b5f-4840-955c-f16cb201fe2b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:28.015125 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d6548a18-1b5f-4840-955c-f16cb201fe2b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:28.015554 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d6548a18-1b5f-4840-955c-f16cb201fe2b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:28.112884 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-d6548a18-1b5f-4840-955c-f16cb201fe2b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lazy-loading 'services' on Instance uuid 6bb2e455-fdfc-4c68-bf38-e569a2797293 {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:32:28.381842 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d6548a18-1b5f-4840-955c-f16cb201fe2b tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments/969357ec-f8f2-4da8-8186-e846d62d49b4" status: 202 len: 0 microversion: 2.1 time: 0.380720 Sep 19 12:32:28.382474 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 312/622] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Sep 19 12:32:27 2022] DELETE /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments/969357ec-f8f2-4da8-8186-e846d62d49b4 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:32:30.577270 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-207b940c-419b-4837-906d-cfea43c9fcad tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:30.577801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-207b940c-419b-4837-906d-cfea43c9fcad tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:30.584529 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-207b940c-419b-4837-906d-cfea43c9fcad tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:30.585029 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-207b940c-419b-4837-906d-cfea43c9fcad tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:30.586091 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-207b940c-419b-4837-906d-cfea43c9fcad tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:30.586788 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-207b940c-419b-4837-906d-cfea43c9fcad tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:30.587235 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-207b940c-419b-4837-906d-cfea43c9fcad tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:30.587649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-207b940c-419b-4837-906d-cfea43c9fcad tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:30.617967 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-207b940c-419b-4837-906d-cfea43c9fcad tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments/98dc4b3a-42d9-4218-8108-6f9527101454" status: 200 len: 194 microversion: 2.1 time: 0.045016 Sep 19 12:32:30.618543 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 311/623] 10.222.0.93 () {58 vars in 1413 bytes} [Mon Sep 19 12:32:30 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments/98dc4b3a-42d9-4218-8108-6f9527101454 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:30.630298 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-1f54cedc-fed9-4fc8-a850-f9d7eb1a202c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:30.630914 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-1f54cedc-fed9-4fc8-a850-f9d7eb1a202c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:30.637373 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1f54cedc-fed9-4fc8-a850-f9d7eb1a202c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:30.637854 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1f54cedc-fed9-4fc8-a850-f9d7eb1a202c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:30.638287 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1f54cedc-fed9-4fc8-a850-f9d7eb1a202c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:30.638975 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1f54cedc-fed9-4fc8-a850-f9d7eb1a202c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:30.639425 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1f54cedc-fed9-4fc8-a850-f9d7eb1a202c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:30.639843 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1f54cedc-fed9-4fc8-a850-f9d7eb1a202c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:30.728517 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-1f54cedc-fed9-4fc8-a850-f9d7eb1a202c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lazy-loading 'services' on Instance uuid 6bb2e455-fdfc-4c68-bf38-e569a2797293 {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:32:30.953868 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-1f54cedc-fed9-4fc8-a850-f9d7eb1a202c tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments/98dc4b3a-42d9-4218-8108-6f9527101454" status: 202 len: 0 microversion: 2.1 time: 0.328174 Sep 19 12:32:30.954536 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 313/624] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Sep 19 12:32:30 2022] DELETE /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments/98dc4b3a-42d9-4218-8108-6f9527101454 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:32:33.192897 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e253bd79-f0ae-462b-b8de-6d615783880d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:33.195115 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-e253bd79-f0ae-462b-b8de-6d615783880d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:33.202227 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e253bd79-f0ae-462b-b8de-6d615783880d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:33.202705 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e253bd79-f0ae-462b-b8de-6d615783880d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:33.203138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e253bd79-f0ae-462b-b8de-6d615783880d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:33.203860 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e253bd79-f0ae-462b-b8de-6d615783880d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:33.204313 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e253bd79-f0ae-462b-b8de-6d615783880d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:33.204775 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e253bd79-f0ae-462b-b8de-6d615783880d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:33.236838 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e253bd79-f0ae-462b-b8de-6d615783880d tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047876 Sep 19 12:32:33.237626 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 312/625] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Sep 19 12:32:33 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 12:32:33.363201 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-bafa8536-dad2-4dd1-8df1-201ee46619fc tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:33.365577 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-bafa8536-dad2-4dd1-8df1-201ee46619fc tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:33.372288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bafa8536-dad2-4dd1-8df1-201ee46619fc tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:33.372902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bafa8536-dad2-4dd1-8df1-201ee46619fc tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:33.373363 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bafa8536-dad2-4dd1-8df1-201ee46619fc tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:33.374089 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bafa8536-dad2-4dd1-8df1-201ee46619fc tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:33.374534 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bafa8536-dad2-4dd1-8df1-201ee46619fc tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:33.374955 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bafa8536-dad2-4dd1-8df1-201ee46619fc tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:33.407029 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-bafa8536-dad2-4dd1-8df1-201ee46619fc tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048813 Sep 19 12:32:33.407630 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 314/626] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Sep 19 12:32:33 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 19 12:32:33.479992 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-a27929c2-ee59-4a3d-a7b6-5fab30e00160 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:33.480698 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-a27929c2-ee59-4a3d-a7b6-5fab30e00160 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:33.486794 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a27929c2-ee59-4a3d-a7b6-5fab30e00160 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:33.487285 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a27929c2-ee59-4a3d-a7b6-5fab30e00160 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:33.487725 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a27929c2-ee59-4a3d-a7b6-5fab30e00160 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:33.488420 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a27929c2-ee59-4a3d-a7b6-5fab30e00160 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:33.488902 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a27929c2-ee59-4a3d-a7b6-5fab30e00160 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:33.489325 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a27929c2-ee59-4a3d-a7b6-5fab30e00160 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:33.515198 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-a27929c2-ee59-4a3d-a7b6-5fab30e00160 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Going to try to terminate instance {{(pid=121429) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:32:33.829989 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-a27929c2-ee59-4a3d-a7b6-5fab30e00160 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 204 len: 0 microversion: 2.1 time: 0.354283 Sep 19 12:32:33.830578 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 313/627] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:32:33 2022] DELETE /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:32:33.839366 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-033dd2b0-b1ed-4a87-9412-069cb3502f93 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:33.839979 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-033dd2b0-b1ed-4a87-9412-069cb3502f93 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:33.845974 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-033dd2b0-b1ed-4a87-9412-069cb3502f93 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:33.846456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-033dd2b0-b1ed-4a87-9412-069cb3502f93 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:33.846888 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-033dd2b0-b1ed-4a87-9412-069cb3502f93 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:33.847576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-033dd2b0-b1ed-4a87-9412-069cb3502f93 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:33.848025 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-033dd2b0-b1ed-4a87-9412-069cb3502f93 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:33.848445 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-033dd2b0-b1ed-4a87-9412-069cb3502f93 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:33.983931 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-033dd2b0-b1ed-4a87-9412-069cb3502f93 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:33.991726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-033dd2b0-b1ed-4a87-9412-069cb3502f93 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 200 len: 1670 microversion: 2.1 time: 0.156816 Sep 19 12:32:33.992294 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 315/628] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:33 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:35.015422 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ba73108e-1b0b-4f4a-be85-b6419f9ffa81 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:35.016127 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ba73108e-1b0b-4f4a-be85-b6419f9ffa81 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:35.018601 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:35.023948 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ba73108e-1b0b-4f4a-be85-b6419f9ffa81 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:35.024433 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ba73108e-1b0b-4f4a-be85-b6419f9ffa81 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:35.024895 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ba73108e-1b0b-4f4a-be85-b6419f9ffa81 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:35.025600 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ba73108e-1b0b-4f4a-be85-b6419f9ffa81 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:35.026050 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ba73108e-1b0b-4f4a-be85-b6419f9ffa81 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:35.026473 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ba73108e-1b0b-4f4a-be85-b6419f9ffa81 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:35.160494 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ba73108e-1b0b-4f4a-be85-b6419f9ffa81 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:35.169450 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ba73108e-1b0b-4f4a-be85-b6419f9ffa81 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 200 len: 1670 microversion: 2.1 time: 0.158600 Sep 19 12:32:35.170397 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 314/629] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:35 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:36.192946 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-7b3b8baf-d23a-433a-936c-c4b1f96bcf8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:36.193694 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-7b3b8baf-d23a-433a-936c-c4b1f96bcf8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:36.196056 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:36.200890 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7b3b8baf-d23a-433a-936c-c4b1f96bcf8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:36.201417 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7b3b8baf-d23a-433a-936c-c4b1f96bcf8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:36.201852 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7b3b8baf-d23a-433a-936c-c4b1f96bcf8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:36.202533 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7b3b8baf-d23a-433a-936c-c4b1f96bcf8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:36.203025 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7b3b8baf-d23a-433a-936c-c4b1f96bcf8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:36.203437 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7b3b8baf-d23a-433a-936c-c4b1f96bcf8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:36.386306 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-7b3b8baf-d23a-433a-936c-c4b1f96bcf8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:36.394689 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-7b3b8baf-d23a-433a-936c-c4b1f96bcf8f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 200 len: 1670 microversion: 2.1 time: 0.205593 Sep 19 12:32:36.395519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 316/630] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:36 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 1670 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:37.300349 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-104e9d4a-6e91-41b7-a96a-aaee56711180 req-525b726a-e27a-4ab0-a598-74204cea58f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb2e455-fdfc-4c68-bf38-e569a2797293", "name": "network-vif-deleted", "tag": "68701594-a5ca-4fef-a35d-f4b800cc2c64"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:37.311977 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-104e9d4a-6e91-41b7-a96a-aaee56711180 req-525b726a-e27a-4ab0-a598-74204cea58f2 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:37.312455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-104e9d4a-6e91-41b7-a96a-aaee56711180 req-525b726a-e27a-4ab0-a598-74204cea58f2 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:37.313096 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-104e9d4a-6e91-41b7-a96a-aaee56711180 req-525b726a-e27a-4ab0-a598-74204cea58f2 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:37.325616 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-104e9d4a-6e91-41b7-a96a-aaee56711180 req-525b726a-e27a-4ab0-a598-74204cea58f2 service nova] Creating event network-vif-deleted:68701594-a5ca-4fef-a35d-f4b800cc2c64 for instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 on hv-cinder-85061 Sep 19 12:32:37.331059 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-104e9d4a-6e91-41b7-a96a-aaee56711180 req-525b726a-e27a-4ab0-a598-74204cea58f2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034408 Sep 19 12:32:37.331669 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 315/631] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:37.419493 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-46e1d65b-54a5-4d90-b843-d16a07e49f0f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:37.420302 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-46e1d65b-54a5-4d90-b843-d16a07e49f0f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:37.427797 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-46e1d65b-54a5-4d90-b843-d16a07e49f0f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:37.428455 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-46e1d65b-54a5-4d90-b843-d16a07e49f0f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:37.429538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-46e1d65b-54a5-4d90-b843-d16a07e49f0f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:37.430426 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-46e1d65b-54a5-4d90-b843-d16a07e49f0f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:37.430977 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-46e1d65b-54a5-4d90-b843-d16a07e49f0f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:37.431507 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-46e1d65b-54a5-4d90-b843-d16a07e49f0f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:37.510706 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-46e1d65b-54a5-4d90-b843-d16a07e49f0f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:37.521377 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-46e1d65b-54a5-4d90-b843-d16a07e49f0f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 200 len: 1604 microversion: 2.1 time: 0.105742 Sep 19 12:32:37.522195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 317/632] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:37 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 1604 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:38.551248 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-1e09cb2a-ddb9-4471-89af-defaabfcc60f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:38.551248 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-1e09cb2a-ddb9-4471-89af-defaabfcc60f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:38.555063 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1e09cb2a-ddb9-4471-89af-defaabfcc60f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:38.555559 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1e09cb2a-ddb9-4471-89af-defaabfcc60f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:38.555998 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1e09cb2a-ddb9-4471-89af-defaabfcc60f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:38.563047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1e09cb2a-ddb9-4471-89af-defaabfcc60f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:38.563047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1e09cb2a-ddb9-4471-89af-defaabfcc60f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:38.563047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1e09cb2a-ddb9-4471-89af-defaabfcc60f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:38.596581 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1e09cb2a-ddb9-4471-89af-defaabfcc60f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:38.597030 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1e09cb2a-ddb9-4471-89af-defaabfcc60f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:38.597463 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1e09cb2a-ddb9-4471-89af-defaabfcc60f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:38.597893 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.objects.instance [None req-1e09cb2a-ddb9-4471-89af-defaabfcc60f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lazy-loading 'fault' on Instance uuid 6bb2e455-fdfc-4c68-bf38-e569a2797293 {{(pid=121429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:32:38.641489 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-1e09cb2a-ddb9-4471-89af-defaabfcc60f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f97f3f5c2e41c69961dafa9bdf84e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb996219124e819beda67ca498dee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:38.649004 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-1e09cb2a-ddb9-4471-89af-defaabfcc60f tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 200 len: 1327 microversion: 2.1 time: 0.107229 Sep 19 12:32:38.652109 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 316/633] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:38 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 1327 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:39.672581 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-0a5257f6-a745-4778-9341-1e333856a3df tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:39.673125 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-0a5257f6-a745-4778-9341-1e333856a3df tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:39.679715 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0a5257f6-a745-4778-9341-1e333856a3df tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:39.680197 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0a5257f6-a745-4778-9341-1e333856a3df tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:39.680658 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0a5257f6-a745-4778-9341-1e333856a3df tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:39.681360 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0a5257f6-a745-4778-9341-1e333856a3df tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:39.681813 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0a5257f6-a745-4778-9341-1e333856a3df tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:39.682233 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0a5257f6-a745-4778-9341-1e333856a3df tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:39.696698 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-0a5257f6-a745-4778-9341-1e333856a3df tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] HTTP exception thrown: Instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 could not be found. Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-0a5257f6-a745-4778-9341-1e333856a3df tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Request method failure captured: Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 HTTP/1.1 Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKF_zyqdRr1FKPHmS2wTNUv6cYsiPzNC_aOLvs14iigPqYOeW3IOokwD8SsTLMUOONE8tBEme5FKwYbtEX0uiP_PxGKupSQrjG8JYZ381t6EqkdppWftoZQENCpxUgO_R3sMDu_NTAZDjYVXR-n3_VeypsXEKz9ZgwpObkXxzO9mxoew Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 61eb996219124e819beda67ca498dee8 Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-AttachVolumeTestJSON-611028865 Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:32:39.698340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:32:39.700009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/61eb996219124e819beda67ca498dee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_61eb996219124e819beda67ca498dee8", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/61eb996219124e819beda67ca498dee8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/61eb996219124e819beda67ca498dee8"}]}] Sep 19 12:32:39.700009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-AttachVolumeTestJSON-611028865 Sep 19 12:32:39.700009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 61eb996219124e819beda67ca498dee8 Sep 19 12:32:39.700009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-AttachVolumeTestJSON-611028865 Sep 19 12:32:39.700009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-AttachVolumeTestJSON-611028865-project Sep 19 12:32:39.700009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:32:39.700009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:32:39.700009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: b9f97f3f5c2e41c69961dafa9bdf84e8 Sep 19 12:32:39.700009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-AttachVolumeTestJSON-611028865-project Sep 19 12:32:39.700009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:32:39.700009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 could not be found. Sep 19 12:32:39.700009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': '6bb2e455-fdfc-4c68-bf38-e569a2797293'} Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 could not be found. Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:32:39.700972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:32:39.702293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:32:39.702293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:32:39.702293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:32:39.702293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:32:39.702293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:32:39.702293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:32:39.702293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:32:39.702293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 could not be found. Sep 19 12:32:39.702293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:39.702293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:39.702293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:39.702293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:39.702293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:39.702293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:39.702293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:32:39.702293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:32:39.702293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 could not be found. Sep 19 12:32:39.702293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:39.703424 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-0a5257f6-a745-4778-9341-1e333856a3df tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Returning 404 to user: Instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:32:39.703424 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-0a5257f6-a745-4778-9341-1e333856a3df tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 404 len: 111 microversion: 2.1 time: 0.031200 Sep 19 12:32:39.703424 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 318/634] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:39 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:32:39.709467 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-1ab4e75e-fb34-41fd-85e7-4398179574c6 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '.version_select at 0x7f54b334dca0>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:39.830739 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-1ab4e75e-fb34-41fd-85e7-4398179574c6 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-893062961" status: 202 len: 0 microversion: 2.1 time: 0.125089 Sep 19 12:32:39.831338 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 317/635] 10.222.0.93 () {58 vars in 1218 bytes} [Mon Sep 19 12:32:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-893062961 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:32:41.464052 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-fb1efcb7-31ab-4dfc-80d6-79f3cdee3e25 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-554250448"}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:41.464655 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-fb1efcb7-31ab-4dfc-80d6-79f3cdee3e25 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:41.471101 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fb1efcb7-31ab-4dfc-80d6-79f3cdee3e25 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:41.471581 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fb1efcb7-31ab-4dfc-80d6-79f3cdee3e25 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:41.474465 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fb1efcb7-31ab-4dfc-80d6-79f3cdee3e25 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:41.474465 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fb1efcb7-31ab-4dfc-80d6-79f3cdee3e25 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:41.474465 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fb1efcb7-31ab-4dfc-80d6-79f3cdee3e25 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:41.474465 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fb1efcb7-31ab-4dfc-80d6-79f3cdee3e25 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:41.619597 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.network.security_group_api [None req-fb1efcb7-31ab-4dfc-80d6-79f3cdee3e25 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Removing security group d060d448-3d7d-4210-a4c8-79b2239514ac from port 83af7231-e989-47cd-984e-6d5a0ed98d98 Sep 19 12:32:42.032373 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-fb1efcb7-31ab-4dfc-80d6-79f3cdee3e25 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "POST /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87/action" status: 202 len: 0 microversion: 2.1 time: 0.572382 Sep 19 12:32:42.033266 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 319/636] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Sep 19 12:32:41 2022] POST /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87/action => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:32:42.041267 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-4363ba43-26ac-4e5f-86bb-e570055322e5 req-cc1068cc-2181-4e5b-b3e2-281c85ca0c12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "006954cd-d599-4bb6-b64e-3fd4d87f8a87", "tag": "83af7231-e989-47cd-984e-6d5a0ed98d98"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:42.053730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-4363ba43-26ac-4e5f-86bb-e570055322e5 req-cc1068cc-2181-4e5b-b3e2-281c85ca0c12 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:42.055370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-4363ba43-26ac-4e5f-86bb-e570055322e5 req-cc1068cc-2181-4e5b-b3e2-281c85ca0c12 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:42.055918 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-4363ba43-26ac-4e5f-86bb-e570055322e5 req-cc1068cc-2181-4e5b-b3e2-281c85ca0c12 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:42.068720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-4363ba43-26ac-4e5f-86bb-e570055322e5 req-cc1068cc-2181-4e5b-b3e2-281c85ca0c12 service nova] Creating event network-changed:83af7231-e989-47cd-984e-6d5a0ed98d98 for instance 006954cd-d599-4bb6-b64e-3fd4d87f8a87 on hv-cinder-85061 Sep 19 12:32:42.076832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-4363ba43-26ac-4e5f-86bb-e570055322e5 req-cc1068cc-2181-4e5b-b3e2-281c85ca0c12 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039804 Sep 19 12:32:42.078743 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 318/637] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:43.297127 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-951ec58c-b7ac-4f0e-8399-768ed34b1c8a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:43.297715 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-951ec58c-b7ac-4f0e-8399-768ed34b1c8a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:43.305217 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-951ec58c-b7ac-4f0e-8399-768ed34b1c8a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:43.305985 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-951ec58c-b7ac-4f0e-8399-768ed34b1c8a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:43.306384 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-951ec58c-b7ac-4f0e-8399-768ed34b1c8a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:43.307200 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-951ec58c-b7ac-4f0e-8399-768ed34b1c8a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:43.307746 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-951ec58c-b7ac-4f0e-8399-768ed34b1c8a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:43.308287 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-951ec58c-b7ac-4f0e-8399-768ed34b1c8a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:43.330723 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-951ec58c-b7ac-4f0e-8399-768ed34b1c8a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] HTTP exception thrown: Instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 could not be found. Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-951ec58c-b7ac-4f0e-8399-768ed34b1c8a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Request method failure captured: Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: DELETE /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 HTTP/1.1 Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKF_zyqdRr1FKPHmS2wTNUv6cYsiPzNC_aOLvs14iigPqYOeW3IOokwD8SsTLMUOONE8tBEme5FKwYbtEX0uiP_PxGKupSQrjG8JYZ381t6EqkdppWftoZQENCpxUgO_R3sMDu_NTAZDjYVXR-n3_VeypsXEKz9ZgwpObkXxzO9mxoew Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 61eb996219124e819beda67ca498dee8 Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-AttachVolumeTestJSON-611028865 Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:32:43.332520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:32:43.334744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/61eb996219124e819beda67ca498dee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_61eb996219124e819beda67ca498dee8", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/61eb996219124e819beda67ca498dee8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/61eb996219124e819beda67ca498dee8"}]}] Sep 19 12:32:43.334744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-AttachVolumeTestJSON-611028865 Sep 19 12:32:43.334744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 61eb996219124e819beda67ca498dee8 Sep 19 12:32:43.334744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-AttachVolumeTestJSON-611028865 Sep 19 12:32:43.334744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-AttachVolumeTestJSON-611028865-project Sep 19 12:32:43.334744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:32:43.334744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:32:43.334744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: b9f97f3f5c2e41c69961dafa9bdf84e8 Sep 19 12:32:43.334744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-AttachVolumeTestJSON-611028865-project Sep 19 12:32:43.334744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:32:43.334744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 could not be found. Sep 19 12:32:43.334744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': '6bb2e455-fdfc-4c68-bf38-e569a2797293'} Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 could not be found. Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:32:43.339902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 could not be found. Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 could not be found. Sep 19 12:32:43.343027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:43.346447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-951ec58c-b7ac-4f0e-8399-768ed34b1c8a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Returning 404 to user: Instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:32:43.346447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-951ec58c-b7ac-4f0e-8399-768ed34b1c8a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 404 len: 111 microversion: 2.1 time: 0.041314 Sep 19 12:32:43.346447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 320/638] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:32:43 2022] DELETE /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:32:43.351607 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4cebf712-19b0-490f-949b-37e3bc9e0528 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:43.352986 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4cebf712-19b0-490f-949b-37e3bc9e0528 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: 6bb2e455-fdfc-4c68-bf38-e569a2797293] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:43.365503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4cebf712-19b0-490f-949b-37e3bc9e0528 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:43.366858 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4cebf712-19b0-490f-949b-37e3bc9e0528 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:43.367651 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4cebf712-19b0-490f-949b-37e3bc9e0528 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:43.368959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4cebf712-19b0-490f-949b-37e3bc9e0528 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:43.369831 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4cebf712-19b0-490f-949b-37e3bc9e0528 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:43.370617 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4cebf712-19b0-490f-949b-37e3bc9e0528 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:43.398005 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-4cebf712-19b0-490f-949b-37e3bc9e0528 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] HTTP exception thrown: Instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 could not be found. Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4cebf712-19b0-490f-949b-37e3bc9e0528 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Request method failure captured: Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 HTTP/1.1 Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKF_zyqdRr1FKPHmS2wTNUv6cYsiPzNC_aOLvs14iigPqYOeW3IOokwD8SsTLMUOONE8tBEme5FKwYbtEX0uiP_PxGKupSQrjG8JYZ381t6EqkdppWftoZQENCpxUgO_R3sMDu_NTAZDjYVXR-n3_VeypsXEKz9ZgwpObkXxzO9mxoew Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 61eb996219124e819beda67ca498dee8 Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-AttachVolumeTestJSON-611028865 Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:32:43.401446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:32:43.403054 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/61eb996219124e819beda67ca498dee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_61eb996219124e819beda67ca498dee8", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/61eb996219124e819beda67ca498dee8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/61eb996219124e819beda67ca498dee8"}]}] Sep 19 12:32:43.403054 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-AttachVolumeTestJSON-611028865 Sep 19 12:32:43.403054 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 61eb996219124e819beda67ca498dee8 Sep 19 12:32:43.403054 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-AttachVolumeTestJSON-611028865 Sep 19 12:32:43.403054 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-AttachVolumeTestJSON-611028865-project Sep 19 12:32:43.403054 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:32:43.403054 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:32:43.403054 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: b9f97f3f5c2e41c69961dafa9bdf84e8 Sep 19 12:32:43.403054 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-AttachVolumeTestJSON-611028865-project Sep 19 12:32:43.403054 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:32:43.403054 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 could not be found. Sep 19 12:32:43.403054 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': '6bb2e455-fdfc-4c68-bf38-e569a2797293'} Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 could not be found. Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:32:43.403961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:32:43.405911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:32:43.405911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:32:43.405911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:32:43.405911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:32:43.405911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:32:43.405911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:32:43.405911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:32:43.405911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 could not be found. Sep 19 12:32:43.405911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:43.405911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:43.405911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:43.405911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:43.405911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:43.405911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:43.405911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:32:43.405911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:32:43.405911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 could not be found. Sep 19 12:32:43.405911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:43.407225 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4cebf712-19b0-490f-949b-37e3bc9e0528 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Returning 404 to user: Instance 6bb2e455-fdfc-4c68-bf38-e569a2797293 could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:32:43.407225 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4cebf712-19b0-490f-949b-37e3bc9e0528 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293" status: 404 len: 111 microversion: 2.1 time: 0.063699 Sep 19 12:32:43.407225 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 319/639] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:43 2022] GET /compute/v2.1/servers/6bb2e455-fdfc-4c68-bf38-e569a2797293 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:32:43.876952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a5ae58e9-9eb6-461a-b4ca-c15ad74a46be tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:43.882168 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a5ae58e9-9eb6-461a-b4ca-c15ad74a46be tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:43.884401 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a5ae58e9-9eb6-461a-b4ca-c15ad74a46be tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:43.884732 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a5ae58e9-9eb6-461a-b4ca-c15ad74a46be tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:43.899054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a5ae58e9-9eb6-461a-b4ca-c15ad74a46be tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:43.899054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a5ae58e9-9eb6-461a-b4ca-c15ad74a46be tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:43.899054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a5ae58e9-9eb6-461a-b4ca-c15ad74a46be tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:43.899054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a5ae58e9-9eb6-461a-b4ca-c15ad74a46be tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:43.985338 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-a5ae58e9-9eb6-461a-b4ca-c15ad74a46be tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lazy-loading 'services' on Instance uuid 006954cd-d599-4bb6-b64e-3fd4d87f8a87 {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:32:44.096189 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-3f00d532-b428-481e-93ba-84ad092658ff req-b00e55a4-7c2e-4452-a1a8-6ea0e6f5364a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "006954cd-d599-4bb6-b64e-3fd4d87f8a87", "tag": "83af7231-e989-47cd-984e-6d5a0ed98d98"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:44.106642 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-3f00d532-b428-481e-93ba-84ad092658ff req-b00e55a4-7c2e-4452-a1a8-6ea0e6f5364a service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:44.107128 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-3f00d532-b428-481e-93ba-84ad092658ff req-b00e55a4-7c2e-4452-a1a8-6ea0e6f5364a service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:44.107563 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-3f00d532-b428-481e-93ba-84ad092658ff req-b00e55a4-7c2e-4452-a1a8-6ea0e6f5364a service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:44.119803 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-3f00d532-b428-481e-93ba-84ad092658ff req-b00e55a4-7c2e-4452-a1a8-6ea0e6f5364a service nova] Creating event network-changed:83af7231-e989-47cd-984e-6d5a0ed98d98 for instance 006954cd-d599-4bb6-b64e-3fd4d87f8a87 on hv-cinder-85061 Sep 19 12:32:44.125359 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-3f00d532-b428-481e-93ba-84ad092658ff req-b00e55a4-7c2e-4452-a1a8-6ea0e6f5364a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032944 Sep 19 12:32:44.125980 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 320/640] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:32:44.265550 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a5ae58e9-9eb6-461a-b4ca-c15ad74a46be tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "DELETE /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87/os-volume_attachments/b87378e9-451d-4afb-a69d-3f24ae0d101d" status: 202 len: 0 microversion: 2.1 time: 0.391804 Sep 19 12:32:44.266917 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 321/641] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Sep 19 12:32:43 2022] DELETE /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87/os-volume_attachments/b87378e9-451d-4afb-a69d-3f24ae0d101d => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:32:44.290841 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-6fafa16b-b2ed-470e-b53a-bbd4c01e777c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:44.297852 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-6fafa16b-b2ed-470e-b53a-bbd4c01e777c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:44.313573 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6fafa16b-b2ed-470e-b53a-bbd4c01e777c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:44.314494 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6fafa16b-b2ed-470e-b53a-bbd4c01e777c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:44.315975 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6fafa16b-b2ed-470e-b53a-bbd4c01e777c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:44.318562 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6fafa16b-b2ed-470e-b53a-bbd4c01e777c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:44.320434 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6fafa16b-b2ed-470e-b53a-bbd4c01e777c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:44.321563 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6fafa16b-b2ed-470e-b53a-bbd4c01e777c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:44.363018 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-6fafa16b-b2ed-470e-b53a-bbd4c01e777c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087103 Sep 19 12:32:44.364405 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 321/642] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Sep 19 12:32:44 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:44.933151 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c5db8163-f156-4f41-97ff-84adcf1c429a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:44.933892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c5db8163-f156-4f41-97ff-84adcf1c429a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:44.941648 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c5db8163-f156-4f41-97ff-84adcf1c429a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:44.942097 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c5db8163-f156-4f41-97ff-84adcf1c429a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:44.943893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c5db8163-f156-4f41-97ff-84adcf1c429a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:44.945289 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c5db8163-f156-4f41-97ff-84adcf1c429a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:44.945762 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c5db8163-f156-4f41-97ff-84adcf1c429a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:44.946189 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c5db8163-f156-4f41-97ff-84adcf1c429a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:44.961044 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-c5db8163-f156-4f41-97ff-84adcf1c429a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] HTTP exception thrown: Instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 could not be found. Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c5db8163-f156-4f41-97ff-84adcf1c429a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Request method failure captured: Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: DELETE /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 HTTP/1.1 Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKF_zyqdRr1FKPHmS2wTNUv6cYsiPzNC_aOLvs14iigPqYOeW3IOokwD8SsTLMUOONE8tBEme5FKwYbtEX0uiP_PxGKupSQrjG8JYZ381t6EqkdppWftoZQENCpxUgO_R3sMDu_NTAZDjYVXR-n3_VeypsXEKz9ZgwpObkXxzO9mxoew Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 61eb996219124e819beda67ca498dee8 Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-AttachVolumeTestJSON-611028865 Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:32:44.963045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:32:44.964776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/61eb996219124e819beda67ca498dee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_61eb996219124e819beda67ca498dee8", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/61eb996219124e819beda67ca498dee8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/61eb996219124e819beda67ca498dee8"}]}] Sep 19 12:32:44.964776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-AttachVolumeTestJSON-611028865 Sep 19 12:32:44.964776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 61eb996219124e819beda67ca498dee8 Sep 19 12:32:44.964776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-AttachVolumeTestJSON-611028865 Sep 19 12:32:44.964776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-AttachVolumeTestJSON-611028865-project Sep 19 12:32:44.964776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:32:44.964776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:32:44.964776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: b9f97f3f5c2e41c69961dafa9bdf84e8 Sep 19 12:32:44.964776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-AttachVolumeTestJSON-611028865-project Sep 19 12:32:44.964776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:32:44.964776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 could not be found. Sep 19 12:32:44.964776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': 'ded9ef48-10a2-4c68-bf0b-ad0e02e36308'} Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 could not be found. Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:32:44.965727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 could not be found. Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 could not be found. Sep 19 12:32:44.967284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:44.970615 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c5db8163-f156-4f41-97ff-84adcf1c429a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Returning 404 to user: Instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:32:44.971727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c5db8163-f156-4f41-97ff-84adcf1c429a tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 404 len: 111 microversion: 2.1 time: 0.043509 Sep 19 12:32:44.972304 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 322/643] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:32:44 2022] DELETE /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:32:44.982065 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-850c74cb-8f51-4a7c-b332-f7e88d4c8857 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:44.982687 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-850c74cb-8f51-4a7c-b332-f7e88d4c8857 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] [instance: ded9ef48-10a2-4c68-bf0b-ad0e02e36308] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:44.989651 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-850c74cb-8f51-4a7c-b332-f7e88d4c8857 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:44.990446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-850c74cb-8f51-4a7c-b332-f7e88d4c8857 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:44.990878 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-850c74cb-8f51-4a7c-b332-f7e88d4c8857 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:44.992390 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-850c74cb-8f51-4a7c-b332-f7e88d4c8857 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:44.992878 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-850c74cb-8f51-4a7c-b332-f7e88d4c8857 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:44.993311 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-850c74cb-8f51-4a7c-b332-f7e88d4c8857 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-850c74cb-8f51-4a7c-b332-f7e88d4c8857 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] HTTP exception thrown: Instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 could not be found. Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-850c74cb-8f51-4a7c-b332-f7e88d4c8857 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Request method failure captured: Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 HTTP/1.1 Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKF_zyqdRr1FKPHmS2wTNUv6cYsiPzNC_aOLvs14iigPqYOeW3IOokwD8SsTLMUOONE8tBEme5FKwYbtEX0uiP_PxGKupSQrjG8JYZ381t6EqkdppWftoZQENCpxUgO_R3sMDu_NTAZDjYVXR-n3_VeypsXEKz9ZgwpObkXxzO9mxoew Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 61eb996219124e819beda67ca498dee8 Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-AttachVolumeTestJSON-611028865 Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:32:45.017732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:32:45.019509 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/61eb996219124e819beda67ca498dee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_61eb996219124e819beda67ca498dee8", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/61eb996219124e819beda67ca498dee8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/61eb996219124e819beda67ca498dee8"}]}] Sep 19 12:32:45.019509 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-AttachVolumeTestJSON-611028865 Sep 19 12:32:45.019509 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 61eb996219124e819beda67ca498dee8 Sep 19 12:32:45.019509 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-AttachVolumeTestJSON-611028865 Sep 19 12:32:45.019509 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-AttachVolumeTestJSON-611028865-project Sep 19 12:32:45.019509 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:32:45.019509 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:32:45.019509 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: b9f97f3f5c2e41c69961dafa9bdf84e8 Sep 19 12:32:45.019509 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-AttachVolumeTestJSON-611028865-project Sep 19 12:32:45.019509 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:32:45.019509 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 could not be found. Sep 19 12:32:45.019509 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': 'ded9ef48-10a2-4c68-bf0b-ad0e02e36308'} Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 could not be found. Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:32:45.020375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:32:45.021825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:32:45.021825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:32:45.021825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:32:45.021825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:32:45.021825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:32:45.021825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:32:45.021825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:32:45.021825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 could not be found. Sep 19 12:32:45.021825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:45.021825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:45.021825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:45.021825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:45.021825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:45.021825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:45.021825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:32:45.021825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:32:45.021825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 could not be found. Sep 19 12:32:45.021825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:45.023148 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-850c74cb-8f51-4a7c-b332-f7e88d4c8857 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] Returning 404 to user: Instance ded9ef48-10a2-4c68-bf0b-ad0e02e36308 could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:32:45.023148 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-850c74cb-8f51-4a7c-b332-f7e88d4c8857 tempest-AttachVolumeTestJSON-611028865 tempest-AttachVolumeTestJSON-611028865-project] 10.222.0.93 "GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308" status: 404 len: 111 microversion: 2.1 time: 0.041467 Sep 19 12:32:45.023148 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 322/644] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:44 2022] GET /compute/v2.1/servers/ded9ef48-10a2-4c68-bf0b-ad0e02e36308 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:32:45.385493 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-091e1e99-6a43-4eb2-b0f9-597f8d7e648c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:45.387833 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-091e1e99-6a43-4eb2-b0f9-597f8d7e648c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:45.394531 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-091e1e99-6a43-4eb2-b0f9-597f8d7e648c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:45.395195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-091e1e99-6a43-4eb2-b0f9-597f8d7e648c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:45.395706 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-091e1e99-6a43-4eb2-b0f9-597f8d7e648c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:45.396521 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-091e1e99-6a43-4eb2-b0f9-597f8d7e648c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:45.397100 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-091e1e99-6a43-4eb2-b0f9-597f8d7e648c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:45.398121 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-091e1e99-6a43-4eb2-b0f9-597f8d7e648c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:45.435444 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-091e1e99-6a43-4eb2-b0f9-597f8d7e648c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059742 Sep 19 12:32:45.436032 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 323/645] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Sep 19 12:32:45 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 12:32:45.449142 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c726014b-234b-4415-bacb-36cae298fd76 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:45.449808 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c726014b-234b-4415-bacb-36cae298fd76 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:45.456573 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c726014b-234b-4415-bacb-36cae298fd76 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:45.457403 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c726014b-234b-4415-bacb-36cae298fd76 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:45.457836 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c726014b-234b-4415-bacb-36cae298fd76 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:45.458537 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c726014b-234b-4415-bacb-36cae298fd76 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:45.458981 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c726014b-234b-4415-bacb-36cae298fd76 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:45.459404 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c726014b-234b-4415-bacb-36cae298fd76 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:45.548649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-c726014b-234b-4415-bacb-36cae298fd76 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] HTTP exception thrown: Instance 006954cd-d599-4bb6-b64e-3fd4d87f8a87 is not attached to volume b87378e9-451d-4afb-a69d-3f24ae0d101d Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c726014b-234b-4415-bacb-36cae298fd76 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Request method failure captured: Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: DELETE /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87/os-volume_attachments/b87378e9-451d-4afb-a69d-3f24ae0d101d HTTP/1.1 Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKGDNwjjxZpWk58XlRj9K_4jHZFkIMc4Tg2Qy07swNwx_WjMQLd2I111YxoLM598IQAaDvMe7ILTAqjkaz9mMJElZgEhVC_TZIeWCFroRoCvmGrRmgjIrzRM5RAQ-2m5hfy0F5c-2ZkZkFP5BR7COZfszVjAjqkoYVm5Nw1zEb3ADOtE Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: e212d8593720481abae6cfa656f03078 Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-TestMinimumBasicScenario-96285264 Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:32:45.550954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:32:45.552511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e212d8593720481abae6cfa656f03078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e212d8593720481abae6cfa656f03078", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e212d8593720481abae6cfa656f03078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e212d8593720481abae6cfa656f03078"}]}] Sep 19 12:32:45.552511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-TestMinimumBasicScenario-96285264 Sep 19 12:32:45.552511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: e212d8593720481abae6cfa656f03078 Sep 19 12:32:45.552511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-TestMinimumBasicScenario-96285264 Sep 19 12:32:45.552511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-TestMinimumBasicScenario-96285264-project Sep 19 12:32:45.552511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:32:45.552511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:32:45.552511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: be4cbf49e37942729c183cc745da983c Sep 19 12:32:45.552511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-TestMinimumBasicScenario-96285264-project Sep 19 12:32:45.552511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:32:45.552511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance 006954cd-d599-4bb6-b64e-3fd4d87f8a87 is not attached to volume b87378e9-451d-4afb-a69d-3f24ae0d101d Sep 19 12:32:45.553314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'server_id': '006954cd-d599-4bb6-b64e-3fd4d87f8a87', 'id': 'b87378e9-451d-4afb-a69d-3f24ae0d101d'} Sep 19 12:32:45.553314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:32:45.553314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:45.553314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 19 12:32:45.553314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 19 12:32:45.553314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 12:32:45.553314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 12:32:45.553314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 19 12:32:45.553314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 19 12:32:45.553314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b87378e9-451d-4afb-a69d-3f24ae0d101d. Sep 19 12:32:45.553314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:45.553314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:45.553314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:45.553314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:45.553314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:45.553314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:45.553314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:32:45.553314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:32:45.553314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:32:45.554814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:32:45.554814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 19 12:32:45.554814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 12:32:45.554814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 006954cd-d599-4bb6-b64e-3fd4d87f8a87 is not attached to volume b87378e9-451d-4afb-a69d-3f24ae0d101d Sep 19 12:32:45.554814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:45.554814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:45.554814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:45.554814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:45.554814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:45.554814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:45.554814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:32:45.554814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:32:45.554814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 006954cd-d599-4bb6-b64e-3fd4d87f8a87 is not attached to volume b87378e9-451d-4afb-a69d-3f24ae0d101d Sep 19 12:32:45.554814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:32:45.554814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c726014b-234b-4415-bacb-36cae298fd76 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Returning 404 to user: Instance 006954cd-d599-4bb6-b64e-3fd4d87f8a87 is not attached to volume b87378e9-451d-4afb-a69d-3f24ae0d101d {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:32:45.555916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c726014b-234b-4415-bacb-36cae298fd76 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "DELETE /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87/os-volume_attachments/b87378e9-451d-4afb-a69d-3f24ae0d101d" status: 404 len: 154 microversion: 2.1 time: 0.108257 Sep 19 12:32:45.555916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 323/646] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Sep 19 12:32:45 2022] DELETE /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87/os-volume_attachments/b87378e9-451d-4afb-a69d-3f24ae0d101d => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:32:46.875252 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-81240f67-7ce8-49a2-a021-cc0cf740afd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:46.876565 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-81240f67-7ce8-49a2-a021-cc0cf740afd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:46.885111 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81240f67-7ce8-49a2-a021-cc0cf740afd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:46.885911 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81240f67-7ce8-49a2-a021-cc0cf740afd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:46.886527 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81240f67-7ce8-49a2-a021-cc0cf740afd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:46.887331 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81240f67-7ce8-49a2-a021-cc0cf740afd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:46.887810 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81240f67-7ce8-49a2-a021-cc0cf740afd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:46.888239 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81240f67-7ce8-49a2-a021-cc0cf740afd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:46.914396 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-81240f67-7ce8-49a2-a021-cc0cf740afd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Going to try to terminate instance {{(pid=121428) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:32:47.227278 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-81240f67-7ce8-49a2-a021-cc0cf740afd5 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "DELETE /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 204 len: 0 microversion: 2.1 time: 0.354420 Sep 19 12:32:47.228522 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 324/647] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:32:46 2022] DELETE /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:32:47.237225 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e928ae06-355e-4d72-93da-6cc64636452b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:47.237971 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-e928ae06-355e-4d72-93da-6cc64636452b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:47.245807 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e928ae06-355e-4d72-93da-6cc64636452b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:47.246295 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e928ae06-355e-4d72-93da-6cc64636452b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:47.247024 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e928ae06-355e-4d72-93da-6cc64636452b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:47.247784 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e928ae06-355e-4d72-93da-6cc64636452b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:47.248249 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e928ae06-355e-4d72-93da-6cc64636452b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:47.248708 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e928ae06-355e-4d72-93da-6cc64636452b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:47.449282 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e928ae06-355e-4d72-93da-6cc64636452b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:47.463093 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e928ae06-355e-4d72-93da-6cc64636452b tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1554 microversion: 2.1 time: 0.229961 Sep 19 12:32:47.463666 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 324/648] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:47 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1554 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:48.486315 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-81eacdda-a57d-427a-a0b2-bfb5df499ffb tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:48.487041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-81eacdda-a57d-427a-a0b2-bfb5df499ffb tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:48.494423 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81eacdda-a57d-427a-a0b2-bfb5df499ffb tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:48.494910 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81eacdda-a57d-427a-a0b2-bfb5df499ffb tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:48.495347 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81eacdda-a57d-427a-a0b2-bfb5df499ffb tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:48.496053 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81eacdda-a57d-427a-a0b2-bfb5df499ffb tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:48.496501 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81eacdda-a57d-427a-a0b2-bfb5df499ffb tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:48.496956 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81eacdda-a57d-427a-a0b2-bfb5df499ffb tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:48.533044 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=4,nova_cell1:UPDATE=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:48.775673 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-81eacdda-a57d-427a-a0b2-bfb5df499ffb tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:48.788173 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-81eacdda-a57d-427a-a0b2-bfb5df499ffb tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1554 microversion: 2.1 time: 0.305666 Sep 19 12:32:48.789292 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 325/649] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:48 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1554 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:49.824863 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-11b6e769-7665-49e6-be29-8e1dbdb4336c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:49.827260 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-11b6e769-7665-49e6-be29-8e1dbdb4336c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:49.837244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-11b6e769-7665-49e6-be29-8e1dbdb4336c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:49.838539 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-11b6e769-7665-49e6-be29-8e1dbdb4336c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:49.839310 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-11b6e769-7665-49e6-be29-8e1dbdb4336c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:49.840662 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-11b6e769-7665-49e6-be29-8e1dbdb4336c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:49.841277 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-11b6e769-7665-49e6-be29-8e1dbdb4336c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:49.841830 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-11b6e769-7665-49e6-be29-8e1dbdb4336c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:50.080810 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-11b6e769-7665-49e6-be29-8e1dbdb4336c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:50.089447 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-11b6e769-7665-49e6-be29-8e1dbdb4336c tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1554 microversion: 2.1 time: 0.270221 Sep 19 12:32:50.090030 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 325/650] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:49 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1554 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:50.295584 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-7df6dbba-5e1a-4b15-8314-fae6854de54c req-17014a49-dd97-4db4-ba24-f545a3152f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006954cd-d599-4bb6-b64e-3fd4d87f8a87", "name": "network-vif-deleted", "tag": "83af7231-e989-47cd-984e-6d5a0ed98d98"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:50.306509 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-7df6dbba-5e1a-4b15-8314-fae6854de54c req-17014a49-dd97-4db4-ba24-f545a3152f39 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:50.307052 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-7df6dbba-5e1a-4b15-8314-fae6854de54c req-17014a49-dd97-4db4-ba24-f545a3152f39 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:50.307484 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-7df6dbba-5e1a-4b15-8314-fae6854de54c req-17014a49-dd97-4db4-ba24-f545a3152f39 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:50.320550 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-7df6dbba-5e1a-4b15-8314-fae6854de54c req-17014a49-dd97-4db4-ba24-f545a3152f39 service nova] Creating event network-vif-deleted:83af7231-e989-47cd-984e-6d5a0ed98d98 for instance 006954cd-d599-4bb6-b64e-3fd4d87f8a87 on hv-cinder-85061 Sep 19 12:32:50.325951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-7df6dbba-5e1a-4b15-8314-fae6854de54c req-17014a49-dd97-4db4-ba24-f545a3152f39 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034057 Sep 19 12:32:50.326952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 326/651] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:51.117388 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-d3bdb8d4-695f-418a-983e-b2be8e70401d tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:51.117388 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-d3bdb8d4-695f-418a-983e-b2be8e70401d tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:51.122305 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3bdb8d4-695f-418a-983e-b2be8e70401d tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:51.123165 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3bdb8d4-695f-418a-983e-b2be8e70401d tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:51.123779 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3bdb8d4-695f-418a-983e-b2be8e70401d tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:51.124645 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3bdb8d4-695f-418a-983e-b2be8e70401d tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:51.125106 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3bdb8d4-695f-418a-983e-b2be8e70401d tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:51.125776 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3bdb8d4-695f-418a-983e-b2be8e70401d tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:51.156958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3bdb8d4-695f-418a-983e-b2be8e70401d tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:51.157445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3bdb8d4-695f-418a-983e-b2be8e70401d tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:51.157881 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d3bdb8d4-695f-418a-983e-b2be8e70401d tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:51.158369 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.objects.instance [None req-d3bdb8d4-695f-418a-983e-b2be8e70401d tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lazy-loading 'fault' on Instance uuid 006954cd-d599-4bb6-b64e-3fd4d87f8a87 {{(pid=121429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:32:51.201749 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-d3bdb8d4-695f-418a-983e-b2be8e70401d tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4cbf49e37942729c183cc745da983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212d8593720481abae6cfa656f03078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:51.209728 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-d3bdb8d4-695f-418a-983e-b2be8e70401d tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 200 len: 1347 microversion: 2.1 time: 0.100099 Sep 19 12:32:51.210316 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 326/652] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:51 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 1347 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:52.236642 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-de7a6c41-32e9-4eb8-94e3-d80da1cc8140 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:52.237242 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-de7a6c41-32e9-4eb8-94e3-d80da1cc8140 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] [instance: 006954cd-d599-4bb6-b64e-3fd4d87f8a87] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:52.244719 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-de7a6c41-32e9-4eb8-94e3-d80da1cc8140 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:52.245199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-de7a6c41-32e9-4eb8-94e3-d80da1cc8140 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:52.245632 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-de7a6c41-32e9-4eb8-94e3-d80da1cc8140 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:52.246323 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-de7a6c41-32e9-4eb8-94e3-d80da1cc8140 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:52.246765 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-de7a6c41-32e9-4eb8-94e3-d80da1cc8140 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:52.247182 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-de7a6c41-32e9-4eb8-94e3-d80da1cc8140 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:52.261420 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-de7a6c41-32e9-4eb8-94e3-d80da1cc8140 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] HTTP exception thrown: Instance 006954cd-d599-4bb6-b64e-3fd4d87f8a87 could not be found. Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-de7a6c41-32e9-4eb8-94e3-d80da1cc8140 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Request method failure captured: Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 HTTP/1.1 Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKGDNwjjxZpWk58XlRj9K_4jHZFkIMc4Tg2Qy07swNwx_WjMQLd2I111YxoLM598IQAaDvMe7ILTAqjkaz9mMJElZgEhVC_TZIeWCFroRoCvmGrRmgjIrzRM5RAQ-2m5hfy0F5c-2ZkZkFP5BR7COZfszVjAjqkoYVm5Nw1zEb3ADOtE Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: e212d8593720481abae6cfa656f03078 Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-TestMinimumBasicScenario-96285264 Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:32:52.263059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:32:52.264436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e212d8593720481abae6cfa656f03078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e212d8593720481abae6cfa656f03078", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e212d8593720481abae6cfa656f03078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e212d8593720481abae6cfa656f03078"}]}] Sep 19 12:32:52.264436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-TestMinimumBasicScenario-96285264 Sep 19 12:32:52.264436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: e212d8593720481abae6cfa656f03078 Sep 19 12:32:52.264436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-TestMinimumBasicScenario-96285264 Sep 19 12:32:52.264436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-TestMinimumBasicScenario-96285264-project Sep 19 12:32:52.264436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:32:52.264436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:32:52.264436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: be4cbf49e37942729c183cc745da983c Sep 19 12:32:52.264436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-TestMinimumBasicScenario-96285264-project Sep 19 12:32:52.264436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:32:52.264436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance 006954cd-d599-4bb6-b64e-3fd4d87f8a87 could not be found. Sep 19 12:32:52.264436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': '006954cd-d599-4bb6-b64e-3fd4d87f8a87'} Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 006954cd-d599-4bb6-b64e-3fd4d87f8a87 could not be found. Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:32:52.265776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:32:52.267081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:32:52.267081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:32:52.267081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:32:52.267081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:32:52.267081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:32:52.267081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:32:52.267081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:32:52.267081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 006954cd-d599-4bb6-b64e-3fd4d87f8a87 could not be found. Sep 19 12:32:52.267081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:52.267081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:52.267081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:52.267081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:52.267081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:52.267081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:52.267081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:32:52.267081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:32:52.267081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 006954cd-d599-4bb6-b64e-3fd4d87f8a87 could not be found. Sep 19 12:32:52.267081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:32:52.268787 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-de7a6c41-32e9-4eb8-94e3-d80da1cc8140 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Returning 404 to user: Instance 006954cd-d599-4bb6-b64e-3fd4d87f8a87 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:32:52.268787 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-de7a6c41-32e9-4eb8-94e3-d80da1cc8140 tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87" status: 404 len: 111 microversion: 2.1 time: 0.032554 Sep 19 12:32:52.268787 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 327/653] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:52 2022] GET /compute/v2.1/servers/006954cd-d599-4bb6-b64e-3fd4d87f8a87 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:32:52.273397 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-db98ae9a-880b-4b35-b732-c91690fb898d tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] Calling method '.version_select at 0x7f54b3364670>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:52.368776 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-db98ae9a-880b-4b35-b732-c91690fb898d tempest-TestMinimumBasicScenario-96285264 tempest-TestMinimumBasicScenario-96285264-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-742350595" status: 202 len: 0 microversion: 2.1 time: 0.097990 Sep 19 12:32:52.368776 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 327/654] 10.222.0.93 () {58 vars in 1269 bytes} [Mon Sep 19 12:32:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-742350595 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:33:11.000688 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-fb530524-2f65-4a83-a1b7-a9b1fce2ec31 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:11.001294 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-fb530524-2f65-4a83-a1b7-a9b1fce2ec31 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:11.003305 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:11.003962 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=7 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:11.009345 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fb530524-2f65-4a83-a1b7-a9b1fce2ec31 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:11.009813 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fb530524-2f65-4a83-a1b7-a9b1fce2ec31 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:11.010235 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fb530524-2f65-4a83-a1b7-a9b1fce2ec31 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:11.010908 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fb530524-2f65-4a83-a1b7-a9b1fce2ec31 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:11.011349 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fb530524-2f65-4a83-a1b7-a9b1fce2ec31 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:11.011764 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fb530524-2f65-4a83-a1b7-a9b1fce2ec31 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:11.035379 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-fb530524-2f65-4a83-a1b7-a9b1fce2ec31 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/ips" status: 200 len: 152 microversion: 2.20 time: 0.038718 Sep 19 12:33:11.035942 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 328/655] 10.222.0.93 () {60 vars in 1289 bytes} [Mon Sep 19 12:33:10 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:33:11.654007 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:11.658352 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=2 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:11.658926 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-32e52790-89f8-4490-9209-eee969bbfa04 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:11.659434 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-32e52790-89f8-4490-9209-eee969bbfa04 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:11.666003 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-32e52790-89f8-4490-9209-eee969bbfa04 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:11.666481 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-32e52790-89f8-4490-9209-eee969bbfa04 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:11.666918 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-32e52790-89f8-4490-9209-eee969bbfa04 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:11.667626 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-32e52790-89f8-4490-9209-eee969bbfa04 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:11.668136 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-32e52790-89f8-4490-9209-eee969bbfa04 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:11.668588 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-32e52790-89f8-4490-9209-eee969bbfa04 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:11.693052 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-32e52790-89f8-4490-9209-eee969bbfa04 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75/ips" status: 200 len: 150 microversion: 2.1 time: 0.040519 Sep 19 12:33:11.693622 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 328/656] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Sep 19 12:33:11 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:33:13.417868 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-7f9aea08-b9de-4c56-bc34-b9ef0ad2a5c5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:33:13.418421 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-7f9aea08-b9de-4c56-bc34-b9ef0ad2a5c5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:13.426430 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7f9aea08-b9de-4c56-bc34-b9ef0ad2a5c5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:13.427116 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7f9aea08-b9de-4c56-bc34-b9ef0ad2a5c5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:13.427552 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7f9aea08-b9de-4c56-bc34-b9ef0ad2a5c5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:13.428251 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7f9aea08-b9de-4c56-bc34-b9ef0ad2a5c5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:13.428735 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7f9aea08-b9de-4c56-bc34-b9ef0ad2a5c5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:13.429158 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7f9aea08-b9de-4c56-bc34-b9ef0ad2a5c5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:13.453961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2ae2f23c-853e-41bc-af0e-d118357734b3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "259d54ad-0dec-4c4b-bac6-2516c3797d88"}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:33:13.456030 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-7f9aea08-b9de-4c56-bc34-b9ef0ad2a5c5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lazy-loading 'flavor' on Instance uuid 7c5331a8-de67-49e9-a0f6-96c8a1915492 {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:33:13.456428 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2ae2f23c-853e-41bc-af0e-d118357734b3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:13.465111 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2ae2f23c-853e-41bc-af0e-d118357734b3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:13.465612 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2ae2f23c-853e-41bc-af0e-d118357734b3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:13.466064 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2ae2f23c-853e-41bc-af0e-d118357734b3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:13.466769 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2ae2f23c-853e-41bc-af0e-d118357734b3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:13.467218 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2ae2f23c-853e-41bc-af0e-d118357734b3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:13.467640 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2ae2f23c-853e-41bc-af0e-d118357734b3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:14.076455 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-7f9aea08-b9de-4c56-bc34-b9ef0ad2a5c5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "POST /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/action" status: 202 len: 0 microversion: 2.20 time: 0.663864 Sep 19 12:33:14.081801 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 329/657] 10.222.0.93 () {62 vars in 1319 bytes} [Mon Sep 19 12:33:13 2022] POST /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/action => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:33:14.085902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-be1fcc89-45df-4538-a067-f3d14306f731 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:14.087289 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-be1fcc89-45df-4538-a067-f3d14306f731 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:14.093867 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-be1fcc89-45df-4538-a067-f3d14306f731 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:14.094355 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-be1fcc89-45df-4538-a067-f3d14306f731 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:14.094790 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-be1fcc89-45df-4538-a067-f3d14306f731 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:14.095500 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-be1fcc89-45df-4538-a067-f3d14306f731 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:14.095933 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-be1fcc89-45df-4538-a067-f3d14306f731 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:14.096356 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-be1fcc89-45df-4538-a067-f3d14306f731 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:14.238864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-be1fcc89-45df-4538-a067-f3d14306f731 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:14.247996 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-be1fcc89-45df-4538-a067-f3d14306f731 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:14.251682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-be1fcc89-45df-4538-a067-f3d14306f731 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:14.251682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-be1fcc89-45df-4538-a067-f3d14306f731 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1725 microversion: 2.20 time: 0.169002 Sep 19 12:33:14.251682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 330/658] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:14 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:33:14.466263 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2ae2f23c-853e-41bc-af0e-d118357734b3 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "POST /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.016535 Sep 19 12:33:14.466896 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 329/659] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Sep 19 12:33:13 2022] POST /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75/os-volume_attachments => generated 194 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:33:15.278504 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b8733890-8e94-4ff7-9b51-9fa1655ddb1b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:15.279722 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-b8733890-8e94-4ff7-9b51-9fa1655ddb1b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:15.286346 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b8733890-8e94-4ff7-9b51-9fa1655ddb1b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:15.286823 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b8733890-8e94-4ff7-9b51-9fa1655ddb1b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:15.287252 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b8733890-8e94-4ff7-9b51-9fa1655ddb1b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:15.287948 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b8733890-8e94-4ff7-9b51-9fa1655ddb1b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:15.288391 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b8733890-8e94-4ff7-9b51-9fa1655ddb1b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:15.288841 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b8733890-8e94-4ff7-9b51-9fa1655ddb1b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:15.421075 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-b8733890-8e94-4ff7-9b51-9fa1655ddb1b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:15.429260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-b8733890-8e94-4ff7-9b51-9fa1655ddb1b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:15.430718 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-b8733890-8e94-4ff7-9b51-9fa1655ddb1b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:15.431883 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-b8733890-8e94-4ff7-9b51-9fa1655ddb1b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1725 microversion: 2.20 time: 0.158419 Sep 19 12:33:15.432437 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 331/660] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:15 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:16.458685 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2d8dd046-a143-45b5-9055-bfd208308ff7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:16.462642 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2d8dd046-a143-45b5-9055-bfd208308ff7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:16.466481 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2d8dd046-a143-45b5-9055-bfd208308ff7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:16.466939 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2d8dd046-a143-45b5-9055-bfd208308ff7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:16.467395 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2d8dd046-a143-45b5-9055-bfd208308ff7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:16.468076 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2d8dd046-a143-45b5-9055-bfd208308ff7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:16.468517 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2d8dd046-a143-45b5-9055-bfd208308ff7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:16.468958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2d8dd046-a143-45b5-9055-bfd208308ff7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:16.606915 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2d8dd046-a143-45b5-9055-bfd208308ff7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:16.615245 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2d8dd046-a143-45b5-9055-bfd208308ff7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:16.616719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2d8dd046-a143-45b5-9055-bfd208308ff7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:16.618131 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2d8dd046-a143-45b5-9055-bfd208308ff7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1725 microversion: 2.20 time: 0.164213 Sep 19 12:33:16.618708 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 330/661] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:16 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:17.645134 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-76a3fe90-e0b1-42fc-af06-6444b27b2031 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:17.645744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-76a3fe90-e0b1-42fc-af06-6444b27b2031 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:17.652985 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-76a3fe90-e0b1-42fc-af06-6444b27b2031 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:17.653471 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-76a3fe90-e0b1-42fc-af06-6444b27b2031 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:17.653906 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-76a3fe90-e0b1-42fc-af06-6444b27b2031 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:17.654633 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-76a3fe90-e0b1-42fc-af06-6444b27b2031 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:17.655082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-76a3fe90-e0b1-42fc-af06-6444b27b2031 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:17.655502 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-76a3fe90-e0b1-42fc-af06-6444b27b2031 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:17.794264 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-76a3fe90-e0b1-42fc-af06-6444b27b2031 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:17.802761 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-76a3fe90-e0b1-42fc-af06-6444b27b2031 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:17.804240 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-76a3fe90-e0b1-42fc-af06-6444b27b2031 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:17.805453 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-76a3fe90-e0b1-42fc-af06-6444b27b2031 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1725 microversion: 2.20 time: 0.165375 Sep 19 12:33:17.806075 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 332/662] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:17 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:18.832038 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ec131e0d-9bd5-4a09-8abd-e4ad45dca11f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:18.832803 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ec131e0d-9bd5-4a09-8abd-e4ad45dca11f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:18.853550 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ec131e0d-9bd5-4a09-8abd-e4ad45dca11f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:18.854167 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ec131e0d-9bd5-4a09-8abd-e4ad45dca11f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:18.854666 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ec131e0d-9bd5-4a09-8abd-e4ad45dca11f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:18.855434 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ec131e0d-9bd5-4a09-8abd-e4ad45dca11f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:18.856121 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ec131e0d-9bd5-4a09-8abd-e4ad45dca11f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:18.856634 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ec131e0d-9bd5-4a09-8abd-e4ad45dca11f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:19.004880 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ec131e0d-9bd5-4a09-8abd-e4ad45dca11f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:19.022997 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ec131e0d-9bd5-4a09-8abd-e4ad45dca11f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:19.022997 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ec131e0d-9bd5-4a09-8abd-e4ad45dca11f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:19.022997 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ec131e0d-9bd5-4a09-8abd-e4ad45dca11f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1725 microversion: 2.20 time: 0.189674 Sep 19 12:33:19.023700 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 331/663] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:18 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:20.043383 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-67cfb365-1c1b-4f73-8727-4cb567f2a285 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:20.043860 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-67cfb365-1c1b-4f73-8727-4cb567f2a285 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:20.050797 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-67cfb365-1c1b-4f73-8727-4cb567f2a285 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:20.051456 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-67cfb365-1c1b-4f73-8727-4cb567f2a285 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:20.058677 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-67cfb365-1c1b-4f73-8727-4cb567f2a285 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:20.058677 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-67cfb365-1c1b-4f73-8727-4cb567f2a285 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:20.058677 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-67cfb365-1c1b-4f73-8727-4cb567f2a285 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:20.058677 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-67cfb365-1c1b-4f73-8727-4cb567f2a285 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:20.194609 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-67cfb365-1c1b-4f73-8727-4cb567f2a285 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:20.204237 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-67cfb365-1c1b-4f73-8727-4cb567f2a285 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:20.205719 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-67cfb365-1c1b-4f73-8727-4cb567f2a285 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:20.206906 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-67cfb365-1c1b-4f73-8727-4cb567f2a285 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1725 microversion: 2.20 time: 0.168574 Sep 19 12:33:20.207477 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 333/664] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:20 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:33:21.234568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c9f67b40-05f1-4586-b1f6-90a163bf6343 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:21.235223 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c9f67b40-05f1-4586-b1f6-90a163bf6343 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:21.242812 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c9f67b40-05f1-4586-b1f6-90a163bf6343 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:21.243595 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c9f67b40-05f1-4586-b1f6-90a163bf6343 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:21.244096 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c9f67b40-05f1-4586-b1f6-90a163bf6343 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:21.245114 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c9f67b40-05f1-4586-b1f6-90a163bf6343 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:21.245668 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c9f67b40-05f1-4586-b1f6-90a163bf6343 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:21.246320 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c9f67b40-05f1-4586-b1f6-90a163bf6343 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:21.393902 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c9f67b40-05f1-4586-b1f6-90a163bf6343 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:21.402930 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c9f67b40-05f1-4586-b1f6-90a163bf6343 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:21.404405 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c9f67b40-05f1-4586-b1f6-90a163bf6343 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:21.405634 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c9f67b40-05f1-4586-b1f6-90a163bf6343 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1725 microversion: 2.20 time: 0.175528 Sep 19 12:33:21.406197 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 332/665] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:21 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:22.245537 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-950fc766-270e-476e-bb43-23264a3b5bf2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:22.246162 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-950fc766-270e-476e-bb43-23264a3b5bf2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:22.252931 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-950fc766-270e-476e-bb43-23264a3b5bf2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:22.253413 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-950fc766-270e-476e-bb43-23264a3b5bf2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:22.253837 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-950fc766-270e-476e-bb43-23264a3b5bf2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:22.254544 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-950fc766-270e-476e-bb43-23264a3b5bf2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:22.254982 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-950fc766-270e-476e-bb43-23264a3b5bf2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:22.255398 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-950fc766-270e-476e-bb43-23264a3b5bf2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:22.351614 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-950fc766-270e-476e-bb43-23264a3b5bf2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lazy-loading 'services' on Instance uuid 7a1ebcb8-0086-4004-b180-b8e674649b75 {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:33:22.431785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-93936bd4-20d5-4e91-8c9c-f2d00f559ecd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:22.433286 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-93936bd4-20d5-4e91-8c9c-f2d00f559ecd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:22.440217 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-93936bd4-20d5-4e91-8c9c-f2d00f559ecd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:22.440739 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-93936bd4-20d5-4e91-8c9c-f2d00f559ecd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:22.441183 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-93936bd4-20d5-4e91-8c9c-f2d00f559ecd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:22.441904 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-93936bd4-20d5-4e91-8c9c-f2d00f559ecd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:22.442456 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-93936bd4-20d5-4e91-8c9c-f2d00f559ecd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:22.442889 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-93936bd4-20d5-4e91-8c9c-f2d00f559ecd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:22.584890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-93936bd4-20d5-4e91-8c9c-f2d00f559ecd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:22.596005 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-93936bd4-20d5-4e91-8c9c-f2d00f559ecd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:22.596005 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-93936bd4-20d5-4e91-8c9c-f2d00f559ecd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:22.596334 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-93936bd4-20d5-4e91-8c9c-f2d00f559ecd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1725 microversion: 2.20 time: 0.168717 Sep 19 12:33:22.596946 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 333/666] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:22 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:33:22.634425 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-950fc766-270e-476e-bb43-23264a3b5bf2 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75/os-volume_attachments/259d54ad-0dec-4c4b-bac6-2516c3797d88" status: 202 len: 0 microversion: 2.1 time: 0.393137 Sep 19 12:33:22.636929 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 334/667] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Sep 19 12:33:22 2022] DELETE /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75/os-volume_attachments/259d54ad-0dec-4c4b-bac6-2516c3797d88 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:33:22.649744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-afb6a89d-0a4b-469a-8a99-e48ea577947b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:22.654439 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-afb6a89d-0a4b-469a-8a99-e48ea577947b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:22.665450 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-afb6a89d-0a4b-469a-8a99-e48ea577947b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:22.666342 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-afb6a89d-0a4b-469a-8a99-e48ea577947b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:22.667143 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-afb6a89d-0a4b-469a-8a99-e48ea577947b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:22.668440 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-afb6a89d-0a4b-469a-8a99-e48ea577947b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:22.669323 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-afb6a89d-0a4b-469a-8a99-e48ea577947b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:22.670088 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-afb6a89d-0a4b-469a-8a99-e48ea577947b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:22.717031 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-afb6a89d-0a4b-469a-8a99-e48ea577947b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075432 Sep 19 12:33:22.717664 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 334/668] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Sep 19 12:33:22 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:33:23.623068 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-16e5aaac-068e-4a50-94bf-13526307f2c4 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:23.623720 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-16e5aaac-068e-4a50-94bf-13526307f2c4 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:23.631064 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-16e5aaac-068e-4a50-94bf-13526307f2c4 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:23.634958 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-16e5aaac-068e-4a50-94bf-13526307f2c4 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:23.634958 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-16e5aaac-068e-4a50-94bf-13526307f2c4 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:23.634958 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-16e5aaac-068e-4a50-94bf-13526307f2c4 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:23.634958 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-16e5aaac-068e-4a50-94bf-13526307f2c4 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:23.635349 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-16e5aaac-068e-4a50-94bf-13526307f2c4 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:23.730624 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-755a1c1f-18f0-4d46-9d4d-7719edee805b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:23.732869 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-755a1c1f-18f0-4d46-9d4d-7719edee805b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:23.739703 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-755a1c1f-18f0-4d46-9d4d-7719edee805b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:23.740337 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-755a1c1f-18f0-4d46-9d4d-7719edee805b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:23.741014 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-755a1c1f-18f0-4d46-9d4d-7719edee805b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:23.745915 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-755a1c1f-18f0-4d46-9d4d-7719edee805b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:23.745915 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-755a1c1f-18f0-4d46-9d4d-7719edee805b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:23.745915 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-755a1c1f-18f0-4d46-9d4d-7719edee805b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:23.790806 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-755a1c1f-18f0-4d46-9d4d-7719edee805b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064850 Sep 19 12:33:23.791392 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 335/669] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Sep 19 12:33:23 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 19 12:33:23.792553 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-16e5aaac-068e-4a50-94bf-13526307f2c4 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:23.800995 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-16e5aaac-068e-4a50-94bf-13526307f2c4 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:23.802460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-16e5aaac-068e-4a50-94bf-13526307f2c4 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:23.803653 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-16e5aaac-068e-4a50-94bf-13526307f2c4 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1725 microversion: 2.20 time: 0.185102 Sep 19 12:33:23.804529 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 335/670] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:23 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:23.863991 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-cb747c28-d576-47d7-86ab-bf15069bd16b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:23.864642 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-cb747c28-d576-47d7-86ab-bf15069bd16b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:23.871143 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cb747c28-d576-47d7-86ab-bf15069bd16b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:23.871640 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cb747c28-d576-47d7-86ab-bf15069bd16b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:23.872169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cb747c28-d576-47d7-86ab-bf15069bd16b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:23.872913 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cb747c28-d576-47d7-86ab-bf15069bd16b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:23.874045 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cb747c28-d576-47d7-86ab-bf15069bd16b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:23.874045 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-cb747c28-d576-47d7-86ab-bf15069bd16b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:23.902356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-cb747c28-d576-47d7-86ab-bf15069bd16b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Going to try to terminate instance {{(pid=121429) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:33:24.332509 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-cb747c28-d576-47d7-86ab-bf15069bd16b tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 204 len: 0 microversion: 2.1 time: 0.476219 Sep 19 12:33:24.333258 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 336/671] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:33:23 2022] DELETE /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 12:33:24.342074 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e8257a30-3ffa-42a0-bb08-279dcba83961 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:24.342698 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e8257a30-3ffa-42a0-bb08-279dcba83961 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:24.349178 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e8257a30-3ffa-42a0-bb08-279dcba83961 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:24.349669 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e8257a30-3ffa-42a0-bb08-279dcba83961 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:24.350125 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e8257a30-3ffa-42a0-bb08-279dcba83961 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:24.350818 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e8257a30-3ffa-42a0-bb08-279dcba83961 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:24.351265 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e8257a30-3ffa-42a0-bb08-279dcba83961 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:24.351693 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e8257a30-3ffa-42a0-bb08-279dcba83961 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:24.496700 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e8257a30-3ffa-42a0-bb08-279dcba83961 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:24.505011 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e8257a30-3ffa-42a0-bb08-279dcba83961 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 200 len: 1681 microversion: 2.1 time: 0.166824 Sep 19 12:33:24.505591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 336/672] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:24 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:33:24.829769 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-0d249f86-764c-421c-969e-fbbec1b63c83 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:24.830467 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-0d249f86-764c-421c-969e-fbbec1b63c83 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:24.836918 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0d249f86-764c-421c-969e-fbbec1b63c83 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:24.837400 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0d249f86-764c-421c-969e-fbbec1b63c83 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:24.837833 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0d249f86-764c-421c-969e-fbbec1b63c83 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:24.838561 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0d249f86-764c-421c-969e-fbbec1b63c83 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:24.839006 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0d249f86-764c-421c-969e-fbbec1b63c83 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:24.839427 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0d249f86-764c-421c-969e-fbbec1b63c83 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:24.973331 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-0d249f86-764c-421c-969e-fbbec1b63c83 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:24.983485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-0d249f86-764c-421c-969e-fbbec1b63c83 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:24.984981 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-0d249f86-764c-421c-969e-fbbec1b63c83 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:24.986174 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-0d249f86-764c-421c-969e-fbbec1b63c83 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1725 microversion: 2.20 time: 0.160814 Sep 19 12:33:24.986757 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 337/673] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:24 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:25.529684 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ab0e8833-02e2-4ce3-b2b1-c65c55ada6ad tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:25.530290 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-ab0e8833-02e2-4ce3-b2b1-c65c55ada6ad tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:25.536993 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ab0e8833-02e2-4ce3-b2b1-c65c55ada6ad tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:25.537467 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ab0e8833-02e2-4ce3-b2b1-c65c55ada6ad tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:25.537895 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ab0e8833-02e2-4ce3-b2b1-c65c55ada6ad tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:25.538604 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ab0e8833-02e2-4ce3-b2b1-c65c55ada6ad tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:25.539048 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ab0e8833-02e2-4ce3-b2b1-c65c55ada6ad tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:25.539464 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ab0e8833-02e2-4ce3-b2b1-c65c55ada6ad tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:25.674798 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-ab0e8833-02e2-4ce3-b2b1-c65c55ada6ad tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:25.683492 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ab0e8833-02e2-4ce3-b2b1-c65c55ada6ad tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 200 len: 1681 microversion: 2.1 time: 0.157708 Sep 19 12:33:25.684066 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 337/674] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:25 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:26.011606 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3edac4e5-827c-42fc-9168-ab182ab4f52c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:26.012212 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3edac4e5-827c-42fc-9168-ab182ab4f52c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:26.018639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3edac4e5-827c-42fc-9168-ab182ab4f52c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:26.022870 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3edac4e5-827c-42fc-9168-ab182ab4f52c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:26.022870 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3edac4e5-827c-42fc-9168-ab182ab4f52c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:26.022870 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3edac4e5-827c-42fc-9168-ab182ab4f52c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:26.022870 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3edac4e5-827c-42fc-9168-ab182ab4f52c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:26.023243 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3edac4e5-827c-42fc-9168-ab182ab4f52c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:26.157388 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3edac4e5-827c-42fc-9168-ab182ab4f52c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:26.166080 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3edac4e5-827c-42fc-9168-ab182ab4f52c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:26.167635 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3edac4e5-827c-42fc-9168-ab182ab4f52c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:26.168835 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3edac4e5-827c-42fc-9168-ab182ab4f52c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1725 microversion: 2.20 time: 0.161480 Sep 19 12:33:26.169388 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 338/675] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:26 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:26.707615 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-81ddcbee-ea59-4e35-bacf-73d736b3a19c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:26.708227 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-81ddcbee-ea59-4e35-bacf-73d736b3a19c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:26.714218 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81ddcbee-ea59-4e35-bacf-73d736b3a19c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:26.714699 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81ddcbee-ea59-4e35-bacf-73d736b3a19c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:26.715131 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81ddcbee-ea59-4e35-bacf-73d736b3a19c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:26.715830 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81ddcbee-ea59-4e35-bacf-73d736b3a19c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:26.716318 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81ddcbee-ea59-4e35-bacf-73d736b3a19c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:26.716801 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-81ddcbee-ea59-4e35-bacf-73d736b3a19c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:26.945428 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-81ddcbee-ea59-4e35-bacf-73d736b3a19c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:26.946512 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-81ddcbee-ea59-4e35-bacf-73d736b3a19c tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 200 len: 1681 microversion: 2.1 time: 0.243566 Sep 19 12:33:26.947098 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 338/676] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:26 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 1681 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:33:27.194783 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e1efe827-ec2d-46d2-8369-8718a6bac409 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:27.195457 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-e1efe827-ec2d-46d2-8369-8718a6bac409 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:27.201963 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e1efe827-ec2d-46d2-8369-8718a6bac409 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:27.205320 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e1efe827-ec2d-46d2-8369-8718a6bac409 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:27.205320 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e1efe827-ec2d-46d2-8369-8718a6bac409 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:27.205320 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e1efe827-ec2d-46d2-8369-8718a6bac409 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:27.205320 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e1efe827-ec2d-46d2-8369-8718a6bac409 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:27.205669 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e1efe827-ec2d-46d2-8369-8718a6bac409 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:27.370277 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e1efe827-ec2d-46d2-8369-8718a6bac409 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:27.378862 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e1efe827-ec2d-46d2-8369-8718a6bac409 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:27.380324 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e1efe827-ec2d-46d2-8369-8718a6bac409 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:27.381543 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e1efe827-ec2d-46d2-8369-8718a6bac409 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1725 microversion: 2.20 time: 0.190952 Sep 19 12:33:27.382099 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 339/677] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:27 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:27.632986 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-92e85840-3113-4d70-9ca0-019d46529972 req-5cc0362f-26ca-46ba-a1d0-f9d99c51c531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a1ebcb8-0086-4004-b180-b8e674649b75", "name": "network-vif-deleted", "tag": "3501b95d-b6c9-49f3-9b9e-c60d361550ad"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:33:27.642894 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-92e85840-3113-4d70-9ca0-019d46529972 req-5cc0362f-26ca-46ba-a1d0-f9d99c51c531 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:27.643373 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-92e85840-3113-4d70-9ca0-019d46529972 req-5cc0362f-26ca-46ba-a1d0-f9d99c51c531 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:27.643803 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-92e85840-3113-4d70-9ca0-019d46529972 req-5cc0362f-26ca-46ba-a1d0-f9d99c51c531 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:27.655809 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-92e85840-3113-4d70-9ca0-019d46529972 req-5cc0362f-26ca-46ba-a1d0-f9d99c51c531 service nova] Creating event network-vif-deleted:3501b95d-b6c9-49f3-9b9e-c60d361550ad for instance 7a1ebcb8-0086-4004-b180-b8e674649b75 on hv-cinder-85061 Sep 19 12:33:27.660739 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-92e85840-3113-4d70-9ca0-019d46529972 req-5cc0362f-26ca-46ba-a1d0-f9d99c51c531 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031687 Sep 19 12:33:27.661408 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 339/678] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:33:27.970529 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-018f3491-8c4d-4c65-8ff8-c9358576a573 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:27.971060 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-018f3491-8c4d-4c65-8ff8-c9358576a573 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:27.977239 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-018f3491-8c4d-4c65-8ff8-c9358576a573 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:27.977965 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-018f3491-8c4d-4c65-8ff8-c9358576a573 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:27.978391 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-018f3491-8c4d-4c65-8ff8-c9358576a573 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:27.979094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-018f3491-8c4d-4c65-8ff8-c9358576a573 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:27.979544 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-018f3491-8c4d-4c65-8ff8-c9358576a573 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:27.979967 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-018f3491-8c4d-4c65-8ff8-c9358576a573 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:28.011975 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-018f3491-8c4d-4c65-8ff8-c9358576a573 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:28.012454 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-018f3491-8c4d-4c65-8ff8-c9358576a573 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:28.012909 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-018f3491-8c4d-4c65-8ff8-c9358576a573 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:28.013358 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.objects.instance [None req-018f3491-8c4d-4c65-8ff8-c9358576a573 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lazy-loading 'fault' on Instance uuid 7a1ebcb8-0086-4004-b180-b8e674649b75 {{(pid=121429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:33:28.060933 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-018f3491-8c4d-4c65-8ff8-c9358576a573 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a48e0ab477f43d294607d441af0b444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68496d9aa29542139f00104051248a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:28.069715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-018f3491-8c4d-4c65-8ff8-c9358576a573 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 200 len: 1331 microversion: 2.1 time: 0.103076 Sep 19 12:33:28.070305 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 340/679] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:27 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:28.415424 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-4f3775b1-f144-4fce-87fb-1a46feb7692c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:28.416126 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-4f3775b1-f144-4fce-87fb-1a46feb7692c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:28.423482 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4f3775b1-f144-4fce-87fb-1a46feb7692c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:28.427375 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4f3775b1-f144-4fce-87fb-1a46feb7692c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:28.427375 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4f3775b1-f144-4fce-87fb-1a46feb7692c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:28.427375 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4f3775b1-f144-4fce-87fb-1a46feb7692c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:28.427375 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4f3775b1-f144-4fce-87fb-1a46feb7692c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:28.427976 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4f3775b1-f144-4fce-87fb-1a46feb7692c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:28.570105 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-4f3775b1-f144-4fce-87fb-1a46feb7692c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:28.578476 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-4f3775b1-f144-4fce-87fb-1a46feb7692c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:28.579921 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-4f3775b1-f144-4fce-87fb-1a46feb7692c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:28.581197 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-4f3775b1-f144-4fce-87fb-1a46feb7692c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1725 microversion: 2.20 time: 0.171304 Sep 19 12:33:28.581676 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 340/680] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:28 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:29.094837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-542f112b-3120-4305-98d3-a9120c0c7a26 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:29.095453 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-542f112b-3120-4305-98d3-a9120c0c7a26 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:29.102035 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-542f112b-3120-4305-98d3-a9120c0c7a26 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:29.102517 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-542f112b-3120-4305-98d3-a9120c0c7a26 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:29.102953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-542f112b-3120-4305-98d3-a9120c0c7a26 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:29.103652 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-542f112b-3120-4305-98d3-a9120c0c7a26 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:29.104108 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-542f112b-3120-4305-98d3-a9120c0c7a26 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:29.104661 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-542f112b-3120-4305-98d3-a9120c0c7a26 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:29.118751 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-542f112b-3120-4305-98d3-a9120c0c7a26 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] HTTP exception thrown: Instance 7a1ebcb8-0086-4004-b180-b8e674649b75 could not be found. Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-542f112b-3120-4305-98d3-a9120c0c7a26 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Request method failure captured: Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 HTTP/1.1 Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKF_xba_JzZBCLNYzS-MR7i3MH3BmQnGBrtpnxxJ02XYU-aLwAMxUp37Js2oVsjZH1Xi2UqEV1PX4cz9KrfQYP2FUn0P4VJxchdxu1X2bfyWUsNGE-kHp0diwIJQq10d4xyW6w1vIK1PG2u4EnZQQclxeJyL0DgqKkwpL098U-5D5sHs Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:33:29.120828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:33:29.122476 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_68496d9aa29542139f00104051248a5b", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/68496d9aa29542139f00104051248a5b"}]}] Sep 19 12:33:29.122476 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:29.122476 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:33:29.122476 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:29.122476 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:33:29.122476 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:33:29.122476 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:33:29.122476 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 3a48e0ab477f43d294607d441af0b444 Sep 19 12:33:29.122476 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:33:29.122476 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:33:29.122476 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance 7a1ebcb8-0086-4004-b180-b8e674649b75 could not be found. Sep 19 12:33:29.122476 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': '7a1ebcb8-0086-4004-b180-b8e674649b75'} Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a1ebcb8-0086-4004-b180-b8e674649b75 could not be found. Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:33:29.123291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:33:29.124704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:33:29.124704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:33:29.124704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:33:29.124704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:33:29.124704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:33:29.124704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:33:29.124704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:33:29.124704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a1ebcb8-0086-4004-b180-b8e674649b75 could not be found. Sep 19 12:33:29.124704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:29.124704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:29.124704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:29.124704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:29.124704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:29.124704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:29.124704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:33:29.124704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:33:29.124704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a1ebcb8-0086-4004-b180-b8e674649b75 could not be found. Sep 19 12:33:29.124704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:29.125956 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-542f112b-3120-4305-98d3-a9120c0c7a26 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Returning 404 to user: Instance 7a1ebcb8-0086-4004-b180-b8e674649b75 could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:33:29.125956 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-542f112b-3120-4305-98d3-a9120c0c7a26 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 404 len: 111 microversion: 2.1 time: 0.031280 Sep 19 12:33:29.125956 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 341/681] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:29 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:33:29.131795 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ca8ad456-9324-4fd7-a004-33e77c1c9c48 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '.version_select at 0x7f54b34508b0>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:29.264153 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ca8ad456-9324-4fd7-a004-33e77c1c9c48 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-341852389" status: 202 len: 0 microversion: 2.1 time: 0.136907 Sep 19 12:33:29.264772 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 341/682] 10.222.0.93 () {58 vars in 1218 bytes} [Mon Sep 19 12:33:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-341852389 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:33:29.608436 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ae57689b-2870-445b-9d04-2d0b0487c8a8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:29.609151 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ae57689b-2870-445b-9d04-2d0b0487c8a8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:29.616064 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ae57689b-2870-445b-9d04-2d0b0487c8a8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:29.616607 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ae57689b-2870-445b-9d04-2d0b0487c8a8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:29.617067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ae57689b-2870-445b-9d04-2d0b0487c8a8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:29.617778 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ae57689b-2870-445b-9d04-2d0b0487c8a8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:29.618225 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ae57689b-2870-445b-9d04-2d0b0487c8a8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:29.618951 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ae57689b-2870-445b-9d04-2d0b0487c8a8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:29.623784 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:30.072075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ae57689b-2870-445b-9d04-2d0b0487c8a8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:30.082404 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ae57689b-2870-445b-9d04-2d0b0487c8a8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:30.083881 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ae57689b-2870-445b-9d04-2d0b0487c8a8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:30.085138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ae57689b-2870-445b-9d04-2d0b0487c8a8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1725 microversion: 2.20 time: 0.481455 Sep 19 12:33:30.085705 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 342/683] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:29 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1725 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:31.113632 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f1dc81fb-6255-4a44-9c69-69e155d211a3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:31.114694 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f1dc81fb-6255-4a44-9c69-69e155d211a3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:31.123494 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f1dc81fb-6255-4a44-9c69-69e155d211a3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:31.126161 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f1dc81fb-6255-4a44-9c69-69e155d211a3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:31.126161 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f1dc81fb-6255-4a44-9c69-69e155d211a3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:31.126679 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f1dc81fb-6255-4a44-9c69-69e155d211a3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:31.127467 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f1dc81fb-6255-4a44-9c69-69e155d211a3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:31.128072 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f1dc81fb-6255-4a44-9c69-69e155d211a3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:31.279984 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f1dc81fb-6255-4a44-9c69-69e155d211a3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:31.290741 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f1dc81fb-6255-4a44-9c69-69e155d211a3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:31.292346 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f1dc81fb-6255-4a44-9c69-69e155d211a3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:31.293849 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f1dc81fb-6255-4a44-9c69-69e155d211a3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1746 microversion: 2.20 time: 0.186259 Sep 19 12:33:31.294429 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 342/684] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:31 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1746 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:31.875334 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-365e6add-69ed-4244-898f-63fc6facfaca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:31.875963 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-365e6add-69ed-4244-898f-63fc6facfaca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:31.883616 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-365e6add-69ed-4244-898f-63fc6facfaca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:31.884136 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-365e6add-69ed-4244-898f-63fc6facfaca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:31.884577 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-365e6add-69ed-4244-898f-63fc6facfaca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:31.885323 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-365e6add-69ed-4244-898f-63fc6facfaca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:31.885776 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-365e6add-69ed-4244-898f-63fc6facfaca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:31.886201 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-365e6add-69ed-4244-898f-63fc6facfaca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:31.901705 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-365e6add-69ed-4244-898f-63fc6facfaca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] HTTP exception thrown: Instance 7a1ebcb8-0086-4004-b180-b8e674649b75 could not be found. Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-365e6add-69ed-4244-898f-63fc6facfaca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Request method failure captured: Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: DELETE /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 HTTP/1.1 Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKF_xba_JzZBCLNYzS-MR7i3MH3BmQnGBrtpnxxJ02XYU-aLwAMxUp37Js2oVsjZH1Xi2UqEV1PX4cz9KrfQYP2FUn0P4VJxchdxu1X2bfyWUsNGE-kHp0diwIJQq10d4xyW6w1vIK1PG2u4EnZQQclxeJyL0DgqKkwpL098U-5D5sHs Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:33:31.903629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:33:31.905262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_68496d9aa29542139f00104051248a5b", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/68496d9aa29542139f00104051248a5b"}]}] Sep 19 12:33:31.905262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:31.905262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:33:31.905262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:31.905262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:33:31.905262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:33:31.905262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:33:31.905262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 3a48e0ab477f43d294607d441af0b444 Sep 19 12:33:31.905262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:33:31.905262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:33:31.905262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance 7a1ebcb8-0086-4004-b180-b8e674649b75 could not be found. Sep 19 12:33:31.905262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': '7a1ebcb8-0086-4004-b180-b8e674649b75'} Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a1ebcb8-0086-4004-b180-b8e674649b75 could not be found. Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:33:31.906134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a1ebcb8-0086-4004-b180-b8e674649b75 could not be found. Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a1ebcb8-0086-4004-b180-b8e674649b75 could not be found. Sep 19 12:33:31.907744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:31.909262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-365e6add-69ed-4244-898f-63fc6facfaca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Returning 404 to user: Instance 7a1ebcb8-0086-4004-b180-b8e674649b75 could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:33:31.909262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-365e6add-69ed-4244-898f-63fc6facfaca tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 404 len: 111 microversion: 2.1 time: 0.033559 Sep 19 12:33:31.909262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 343/685] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:33:31 2022] DELETE /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:33:31.914343 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b66c3f6a-2637-4c3f-8e11-64f18c5a5ece tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:31.914955 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-b66c3f6a-2637-4c3f-8e11-64f18c5a5ece tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 7a1ebcb8-0086-4004-b180-b8e674649b75] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:31.922107 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b66c3f6a-2637-4c3f-8e11-64f18c5a5ece tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:31.922600 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b66c3f6a-2637-4c3f-8e11-64f18c5a5ece tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:31.923036 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b66c3f6a-2637-4c3f-8e11-64f18c5a5ece tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:31.923753 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b66c3f6a-2637-4c3f-8e11-64f18c5a5ece tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:31.924209 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b66c3f6a-2637-4c3f-8e11-64f18c5a5ece tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:31.924664 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b66c3f6a-2637-4c3f-8e11-64f18c5a5ece tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:31.939384 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-b66c3f6a-2637-4c3f-8e11-64f18c5a5ece tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] HTTP exception thrown: Instance 7a1ebcb8-0086-4004-b180-b8e674649b75 could not be found. Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b66c3f6a-2637-4c3f-8e11-64f18c5a5ece tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Request method failure captured: Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 HTTP/1.1 Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKF_xba_JzZBCLNYzS-MR7i3MH3BmQnGBrtpnxxJ02XYU-aLwAMxUp37Js2oVsjZH1Xi2UqEV1PX4cz9KrfQYP2FUn0P4VJxchdxu1X2bfyWUsNGE-kHp0diwIJQq10d4xyW6w1vIK1PG2u4EnZQQclxeJyL0DgqKkwpL098U-5D5sHs Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:33:31.941139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:33:31.942742 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_68496d9aa29542139f00104051248a5b", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/68496d9aa29542139f00104051248a5b"}]}] Sep 19 12:33:31.942742 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:31.942742 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:33:31.942742 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:31.942742 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:33:31.942742 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:33:31.942742 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:33:31.942742 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: 3a48e0ab477f43d294607d441af0b444 Sep 19 12:33:31.942742 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:33:31.942742 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:33:31.942742 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance 7a1ebcb8-0086-4004-b180-b8e674649b75 could not be found. Sep 19 12:33:31.942742 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': '7a1ebcb8-0086-4004-b180-b8e674649b75'} Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a1ebcb8-0086-4004-b180-b8e674649b75 could not be found. Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:33:31.943538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:33:31.945033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:33:31.945033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:33:31.945033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:33:31.945033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:33:31.945033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:33:31.945033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:33:31.945033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:33:31.945033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a1ebcb8-0086-4004-b180-b8e674649b75 could not be found. Sep 19 12:33:31.945033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:31.945033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:31.945033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:31.945033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:31.945033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:31.945033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:31.945033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:33:31.945033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:33:31.945033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a1ebcb8-0086-4004-b180-b8e674649b75 could not be found. Sep 19 12:33:31.945033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:31.946310 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b66c3f6a-2637-4c3f-8e11-64f18c5a5ece tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Returning 404 to user: Instance 7a1ebcb8-0086-4004-b180-b8e674649b75 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:33:31.946310 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-b66c3f6a-2637-4c3f-8e11-64f18c5a5ece tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75" status: 404 len: 111 microversion: 2.1 time: 0.032259 Sep 19 12:33:31.946310 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 343/686] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:31 2022] GET /compute/v2.1/servers/7a1ebcb8-0086-4004-b180-b8e674649b75 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 12:33:32.320867 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4bb3a0c0-da27-423f-86ad-1da40892da52 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:32.321481 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4bb3a0c0-da27-423f-86ad-1da40892da52 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:32.328172 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4bb3a0c0-da27-423f-86ad-1da40892da52 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:32.328687 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4bb3a0c0-da27-423f-86ad-1da40892da52 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:32.329126 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4bb3a0c0-da27-423f-86ad-1da40892da52 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:32.330020 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4bb3a0c0-da27-423f-86ad-1da40892da52 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:32.330363 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4bb3a0c0-da27-423f-86ad-1da40892da52 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:32.330830 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4bb3a0c0-da27-423f-86ad-1da40892da52 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:32.471956 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-4bb3a0c0-da27-423f-86ad-1da40892da52 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:32.485108 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-4bb3a0c0-da27-423f-86ad-1da40892da52 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:32.486566 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-4bb3a0c0-da27-423f-86ad-1da40892da52 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:32.487739 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4bb3a0c0-da27-423f-86ad-1da40892da52 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1741 microversion: 2.20 time: 0.171239 Sep 19 12:33:32.488364 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 344/687] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:32 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:32.679649 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-7748bec5-93b8-45f4-b12c-d6c54cf96442 req-a72a2347-b404-4f34-ae48-11cc66f39159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c5331a8-de67-49e9-a0f6-96c8a1915492", "name": "network-vif-plugged", "status": "completed", "tag": "760b99b4-defc-4bbb-86a7-39ce573ef1d4"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:33:32.691829 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-7748bec5-93b8-45f4-b12c-d6c54cf96442 req-a72a2347-b404-4f34-ae48-11cc66f39159 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:32.692302 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-7748bec5-93b8-45f4-b12c-d6c54cf96442 req-a72a2347-b404-4f34-ae48-11cc66f39159 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:32.692792 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-7748bec5-93b8-45f4-b12c-d6c54cf96442 req-a72a2347-b404-4f34-ae48-11cc66f39159 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:32.705241 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-7748bec5-93b8-45f4-b12c-d6c54cf96442 req-a72a2347-b404-4f34-ae48-11cc66f39159 service nova] Creating event network-vif-plugged:760b99b4-defc-4bbb-86a7-39ce573ef1d4 for instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 on hv-cinder-85061 Sep 19 12:33:32.710451 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-7748bec5-93b8-45f4-b12c-d6c54cf96442 req-a72a2347-b404-4f34-ae48-11cc66f39159 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037134 Sep 19 12:33:32.711085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 344/688] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:33:33.283977 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-13c9147a-91b5-4f27-b787-bb47b0e384ab tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:33.285192 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-13c9147a-91b5-4f27-b787-bb47b0e384ab tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:33.293926 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-13c9147a-91b5-4f27-b787-bb47b0e384ab tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:33.294746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-13c9147a-91b5-4f27-b787-bb47b0e384ab tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:33.297990 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-13c9147a-91b5-4f27-b787-bb47b0e384ab tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:33.298787 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-13c9147a-91b5-4f27-b787-bb47b0e384ab tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:33.299277 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-13c9147a-91b5-4f27-b787-bb47b0e384ab tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:33.299835 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-13c9147a-91b5-4f27-b787-bb47b0e384ab tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:33.315598 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-13c9147a-91b5-4f27-b787-bb47b0e384ab tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] HTTP exception thrown: Instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 could not be found. Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-13c9147a-91b5-4f27-b787-bb47b0e384ab tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Request method failure captured: Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: DELETE /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 HTTP/1.1 Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKF_xba_JzZBCLNYzS-MR7i3MH3BmQnGBrtpnxxJ02XYU-aLwAMxUp37Js2oVsjZH1Xi2UqEV1PX4cz9KrfQYP2FUn0P4VJxchdxu1X2bfyWUsNGE-kHp0diwIJQq10d4xyW6w1vIK1PG2u4EnZQQclxeJyL0DgqKkwpL098U-5D5sHs Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:33:33.317832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:33:33.319321 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_68496d9aa29542139f00104051248a5b", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/68496d9aa29542139f00104051248a5b"}]}] Sep 19 12:33:33.319321 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:33.319321 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:33:33.319321 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:33.319321 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:33:33.319321 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:33:33.319321 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:33:33.319321 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 3a48e0ab477f43d294607d441af0b444 Sep 19 12:33:33.319321 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:33:33.319321 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:33:33.319321 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 could not be found. Sep 19 12:33:33.319321 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': '50dff3e8-23ae-4501-b36a-35a1b3629b13'} Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 could not be found. Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:33:33.320075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 could not be found. Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 could not be found. Sep 19 12:33:33.322138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.324174 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-13c9147a-91b5-4f27-b787-bb47b0e384ab tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Returning 404 to user: Instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:33:33.324174 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-13c9147a-91b5-4f27-b787-bb47b0e384ab tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "DELETE /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 404 len: 111 microversion: 2.1 time: 0.040223 Sep 19 12:33:33.324174 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 345/689] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:33:33 2022] DELETE /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 12:33:33.329564 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b40bdb04-9d25-4b82-8f9f-e57cd5e22517 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:33.330282 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-b40bdb04-9d25-4b82-8f9f-e57cd5e22517 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: 50dff3e8-23ae-4501-b36a-35a1b3629b13] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:33.337420 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b40bdb04-9d25-4b82-8f9f-e57cd5e22517 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:33.337916 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b40bdb04-9d25-4b82-8f9f-e57cd5e22517 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:33.338845 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b40bdb04-9d25-4b82-8f9f-e57cd5e22517 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:33.339567 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b40bdb04-9d25-4b82-8f9f-e57cd5e22517 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:33.350201 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b40bdb04-9d25-4b82-8f9f-e57cd5e22517 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:33.351010 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b40bdb04-9d25-4b82-8f9f-e57cd5e22517 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:33.357739 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:33.373946 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-b40bdb04-9d25-4b82-8f9f-e57cd5e22517 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] HTTP exception thrown: Instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 could not be found. Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b40bdb04-9d25-4b82-8f9f-e57cd5e22517 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Request method failure captured: Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 HTTP/1.1 Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKF_xba_JzZBCLNYzS-MR7i3MH3BmQnGBrtpnxxJ02XYU-aLwAMxUp37Js2oVsjZH1Xi2UqEV1PX4cz9KrfQYP2FUn0P4VJxchdxu1X2bfyWUsNGE-kHp0diwIJQq10d4xyW6w1vIK1PG2u4EnZQQclxeJyL0DgqKkwpL098U-5D5sHs Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:33:33.375734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:33:33.378717 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_68496d9aa29542139f00104051248a5b", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/68496d9aa29542139f00104051248a5b"}]}] Sep 19 12:33:33.378717 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:33.378717 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:33:33.378717 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:33.378717 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:33:33.378717 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:33:33.378717 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:33:33.378717 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: 3a48e0ab477f43d294607d441af0b444 Sep 19 12:33:33.378717 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:33:33.378717 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:33:33.378717 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 could not be found. Sep 19 12:33:33.378717 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': '50dff3e8-23ae-4501-b36a-35a1b3629b13'} Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 could not be found. Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:33:33.380280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:33:33.382475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:33:33.382475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:33:33.382475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:33:33.382475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:33:33.382475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:33:33.382475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:33:33.382475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:33:33.382475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 could not be found. Sep 19 12:33:33.382475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.382475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:33.382475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.382475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:33.382475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:33.382475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:33.382475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:33:33.382475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:33:33.382475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 could not be found. Sep 19 12:33:33.382475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.383960 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b40bdb04-9d25-4b82-8f9f-e57cd5e22517 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Returning 404 to user: Instance 50dff3e8-23ae-4501-b36a-35a1b3629b13 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:33:33.383960 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-b40bdb04-9d25-4b82-8f9f-e57cd5e22517 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13" status: 404 len: 111 microversion: 2.1 time: 0.052453 Sep 19 12:33:33.383960 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 345/690] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:33 2022] GET /compute/v2.1/servers/50dff3e8-23ae-4501-b36a-35a1b3629b13 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:33:33.391731 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-768f2e7e-8a69-4637-8e63-e29cebce4d9e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:33.392506 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-768f2e7e-8a69-4637-8e63-e29cebce4d9e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:33.399740 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-768f2e7e-8a69-4637-8e63-e29cebce4d9e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:33.400442 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-768f2e7e-8a69-4637-8e63-e29cebce4d9e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:33.401920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-768f2e7e-8a69-4637-8e63-e29cebce4d9e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:33.402307 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-768f2e7e-8a69-4637-8e63-e29cebce4d9e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:33.403802 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-768f2e7e-8a69-4637-8e63-e29cebce4d9e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:33.403802 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-768f2e7e-8a69-4637-8e63-e29cebce4d9e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:33.420107 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-768f2e7e-8a69-4637-8e63-e29cebce4d9e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] HTTP exception thrown: Instance ddd91105-a661-4f11-9581-7ba50b06e00f could not be found. Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-768f2e7e-8a69-4637-8e63-e29cebce4d9e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Request method failure captured: Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: DELETE /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f HTTP/1.1 Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKF_xba_JzZBCLNYzS-MR7i3MH3BmQnGBrtpnxxJ02XYU-aLwAMxUp37Js2oVsjZH1Xi2UqEV1PX4cz9KrfQYP2FUn0P4VJxchdxu1X2bfyWUsNGE-kHp0diwIJQq10d4xyW6w1vIK1PG2u4EnZQQclxeJyL0DgqKkwpL098U-5D5sHs Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:33:33.422413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:33:33.423907 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_68496d9aa29542139f00104051248a5b", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/68496d9aa29542139f00104051248a5b"}]}] Sep 19 12:33:33.423907 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:33.423907 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:33:33.423907 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:33.423907 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:33:33.423907 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:33:33.423907 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:33:33.423907 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 3a48e0ab477f43d294607d441af0b444 Sep 19 12:33:33.423907 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:33:33.423907 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:33:33.423907 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance ddd91105-a661-4f11-9581-7ba50b06e00f could not be found. Sep 19 12:33:33.423907 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': 'ddd91105-a661-4f11-9581-7ba50b06e00f'} Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddd91105-a661-4f11-9581-7ba50b06e00f could not be found. Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:33:33.424717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddd91105-a661-4f11-9581-7ba50b06e00f could not be found. Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddd91105-a661-4f11-9581-7ba50b06e00f could not be found. Sep 19 12:33:33.426242 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.427757 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-768f2e7e-8a69-4637-8e63-e29cebce4d9e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Returning 404 to user: Instance ddd91105-a661-4f11-9581-7ba50b06e00f could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:33:33.427757 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-768f2e7e-8a69-4637-8e63-e29cebce4d9e tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 404 len: 111 microversion: 2.1 time: 0.038437 Sep 19 12:33:33.427757 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 346/691] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:33:33 2022] DELETE /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:33:33.432536 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8097e778-8810-4a26-a9fa-ad856d4bee92 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:33.433240 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-8097e778-8810-4a26-a9fa-ad856d4bee92 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: ddd91105-a661-4f11-9581-7ba50b06e00f] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:33.439593 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8097e778-8810-4a26-a9fa-ad856d4bee92 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:33.440074 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8097e778-8810-4a26-a9fa-ad856d4bee92 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:33.440530 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8097e778-8810-4a26-a9fa-ad856d4bee92 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:33.441280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8097e778-8810-4a26-a9fa-ad856d4bee92 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:33.441731 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8097e778-8810-4a26-a9fa-ad856d4bee92 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:33.442145 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8097e778-8810-4a26-a9fa-ad856d4bee92 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:33.476954 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-8097e778-8810-4a26-a9fa-ad856d4bee92 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] HTTP exception thrown: Instance ddd91105-a661-4f11-9581-7ba50b06e00f could not be found. Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8097e778-8810-4a26-a9fa-ad856d4bee92 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Request method failure captured: Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f HTTP/1.1 Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKF_xba_JzZBCLNYzS-MR7i3MH3BmQnGBrtpnxxJ02XYU-aLwAMxUp37Js2oVsjZH1Xi2UqEV1PX4cz9KrfQYP2FUn0P4VJxchdxu1X2bfyWUsNGE-kHp0diwIJQq10d4xyW6w1vIK1PG2u4EnZQQclxeJyL0DgqKkwpL098U-5D5sHs Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:33:33.478808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:33:33.481057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_68496d9aa29542139f00104051248a5b", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/68496d9aa29542139f00104051248a5b"}]}] Sep 19 12:33:33.481057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:33.481057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:33:33.481057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:33.481057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:33:33.481057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:33:33.481057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:33:33.481057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: 3a48e0ab477f43d294607d441af0b444 Sep 19 12:33:33.481057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:33:33.481057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:33:33.481057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance ddd91105-a661-4f11-9581-7ba50b06e00f could not be found. Sep 19 12:33:33.481057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': 'ddd91105-a661-4f11-9581-7ba50b06e00f'} Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddd91105-a661-4f11-9581-7ba50b06e00f could not be found. Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:33:33.481943 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:33:33.483972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:33:33.483972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:33:33.483972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:33:33.483972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:33:33.483972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:33:33.483972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:33:33.483972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:33:33.483972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddd91105-a661-4f11-9581-7ba50b06e00f could not be found. Sep 19 12:33:33.483972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.483972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:33.483972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.483972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:33.483972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:33.483972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:33.483972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:33:33.483972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:33:33.483972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddd91105-a661-4f11-9581-7ba50b06e00f could not be found. Sep 19 12:33:33.483972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:33.486970 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8097e778-8810-4a26-a9fa-ad856d4bee92 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Returning 404 to user: Instance ddd91105-a661-4f11-9581-7ba50b06e00f could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:33:33.489267 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8097e778-8810-4a26-a9fa-ad856d4bee92 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f" status: 404 len: 111 microversion: 2.1 time: 0.059375 Sep 19 12:33:33.493084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 346/692] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:33 2022] GET /compute/v2.1/servers/ddd91105-a661-4f11-9581-7ba50b06e00f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:33:33.515466 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-8722ae68-00c6-464c-9f94-f9cad21c04b1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:33.516539 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-8722ae68-00c6-464c-9f94-f9cad21c04b1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:33.526488 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8722ae68-00c6-464c-9f94-f9cad21c04b1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:33.527006 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8722ae68-00c6-464c-9f94-f9cad21c04b1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:33.527454 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8722ae68-00c6-464c-9f94-f9cad21c04b1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:33.528176 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8722ae68-00c6-464c-9f94-f9cad21c04b1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:33.528860 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8722ae68-00c6-464c-9f94-f9cad21c04b1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:33.529294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8722ae68-00c6-464c-9f94-f9cad21c04b1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:33.690773 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8722ae68-00c6-464c-9f94-f9cad21c04b1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:33.700532 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8722ae68-00c6-464c-9f94-f9cad21c04b1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:33.702521 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8722ae68-00c6-464c-9f94-f9cad21c04b1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:33.704061 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-8722ae68-00c6-464c-9f94-f9cad21c04b1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1741 microversion: 2.20 time: 0.192573 Sep 19 12:33:33.704756 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 347/693] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:33 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:34.733804 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-58ed99bd-3fe2-4c88-a811-575f619c2518 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:34.734466 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-58ed99bd-3fe2-4c88-a811-575f619c2518 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:34.746410 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-58ed99bd-3fe2-4c88-a811-575f619c2518 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:34.748348 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-58ed99bd-3fe2-4c88-a811-575f619c2518 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:34.749054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-58ed99bd-3fe2-4c88-a811-575f619c2518 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:34.749974 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-58ed99bd-3fe2-4c88-a811-575f619c2518 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:34.750604 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-58ed99bd-3fe2-4c88-a811-575f619c2518 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:34.751198 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-58ed99bd-3fe2-4c88-a811-575f619c2518 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:34.917179 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-58ed99bd-3fe2-4c88-a811-575f619c2518 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:34.933140 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-58ed99bd-3fe2-4c88-a811-575f619c2518 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:34.937632 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-58ed99bd-3fe2-4c88-a811-575f619c2518 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:34.941405 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-58ed99bd-3fe2-4c88-a811-575f619c2518 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1741 microversion: 2.20 time: 0.211648 Sep 19 12:33:34.942817 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 347/694] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:34 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1741 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:34.966503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-6614212f-46ae-40c3-b81d-6cf5caac99f8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:34.967696 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-6614212f-46ae-40c3-b81d-6cf5caac99f8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:34.981828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6614212f-46ae-40c3-b81d-6cf5caac99f8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:34.981828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6614212f-46ae-40c3-b81d-6cf5caac99f8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:34.981828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6614212f-46ae-40c3-b81d-6cf5caac99f8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:34.982923 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6614212f-46ae-40c3-b81d-6cf5caac99f8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:34.983492 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6614212f-46ae-40c3-b81d-6cf5caac99f8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:34.983975 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6614212f-46ae-40c3-b81d-6cf5caac99f8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:34.998534 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-6614212f-46ae-40c3-b81d-6cf5caac99f8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] HTTP exception thrown: Instance a4930060-ddb1-4835-a231-ea79ffb14068 could not be found. Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-6614212f-46ae-40c3-b81d-6cf5caac99f8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Request method failure captured: Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: DELETE /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 HTTP/1.1 Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKF_xba_JzZBCLNYzS-MR7i3MH3BmQnGBrtpnxxJ02XYU-aLwAMxUp37Js2oVsjZH1Xi2UqEV1PX4cz9KrfQYP2FUn0P4VJxchdxu1X2bfyWUsNGE-kHp0diwIJQq10d4xyW6w1vIK1PG2u4EnZQQclxeJyL0DgqKkwpL098U-5D5sHs Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:33:35.000194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:33:35.001814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_68496d9aa29542139f00104051248a5b", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/68496d9aa29542139f00104051248a5b"}]}] Sep 19 12:33:35.001814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:35.001814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:33:35.001814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:35.001814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:33:35.001814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:33:35.001814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:33:35.001814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 3a48e0ab477f43d294607d441af0b444 Sep 19 12:33:35.001814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:33:35.001814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:33:35.001814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance a4930060-ddb1-4835-a231-ea79ffb14068 could not be found. Sep 19 12:33:35.001814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': 'a4930060-ddb1-4835-a231-ea79ffb14068'} Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4930060-ddb1-4835-a231-ea79ffb14068 could not be found. Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:33:35.002865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4930060-ddb1-4835-a231-ea79ffb14068 could not be found. Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4930060-ddb1-4835-a231-ea79ffb14068 could not be found. Sep 19 12:33:35.004353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:35.009570 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-6614212f-46ae-40c3-b81d-6cf5caac99f8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Returning 404 to user: Instance a4930060-ddb1-4835-a231-ea79ffb14068 could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:33:35.009570 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-6614212f-46ae-40c3-b81d-6cf5caac99f8 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 404 len: 111 microversion: 2.1 time: 0.044731 Sep 19 12:33:35.009570 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 348/695] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:33:34 2022] DELETE /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:33:35.014520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e4dbfa1e-0967-4b32-9b22-c11d6f4bdb75 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:35.015141 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e4dbfa1e-0967-4b32-9b22-c11d6f4bdb75 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] [instance: a4930060-ddb1-4835-a231-ea79ffb14068] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:35.021930 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e4dbfa1e-0967-4b32-9b22-c11d6f4bdb75 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:35.022424 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e4dbfa1e-0967-4b32-9b22-c11d6f4bdb75 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:35.033977 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e4dbfa1e-0967-4b32-9b22-c11d6f4bdb75 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:35.033977 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e4dbfa1e-0967-4b32-9b22-c11d6f4bdb75 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:35.033977 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e4dbfa1e-0967-4b32-9b22-c11d6f4bdb75 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:35.033977 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e4dbfa1e-0967-4b32-9b22-c11d6f4bdb75 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:35.042511 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-e4dbfa1e-0967-4b32-9b22-c11d6f4bdb75 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] HTTP exception thrown: Instance a4930060-ddb1-4835-a231-ea79ffb14068 could not be found. Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e4dbfa1e-0967-4b32-9b22-c11d6f4bdb75 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Request method failure captured: Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 HTTP/1.1 Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKF_xba_JzZBCLNYzS-MR7i3MH3BmQnGBrtpnxxJ02XYU-aLwAMxUp37Js2oVsjZH1Xi2UqEV1PX4cz9KrfQYP2FUn0P4VJxchdxu1X2bfyWUsNGE-kHp0diwIJQq10d4xyW6w1vIK1PG2u4EnZQQclxeJyL0DgqKkwpL098U-5D5sHs Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:33:35.044319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:33:35.046029 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_68496d9aa29542139f00104051248a5b", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/68496d9aa29542139f00104051248a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/68496d9aa29542139f00104051248a5b"}]}] Sep 19 12:33:35.046029 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:35.046029 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 68496d9aa29542139f00104051248a5b Sep 19 12:33:35.046029 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505595249 Sep 19 12:33:35.046029 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:33:35.046029 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:33:35.046029 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:33:35.046029 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: 3a48e0ab477f43d294607d441af0b444 Sep 19 12:33:35.046029 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-AttachVolumeNegativeTest-1505595249-project Sep 19 12:33:35.046029 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:33:35.046029 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance a4930060-ddb1-4835-a231-ea79ffb14068 could not be found. Sep 19 12:33:35.046029 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': 'a4930060-ddb1-4835-a231-ea79ffb14068'} Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4930060-ddb1-4835-a231-ea79ffb14068 could not be found. Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:33:35.046886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:33:35.048288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:33:35.048288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:33:35.048288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:33:35.048288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:33:35.048288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:33:35.048288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:33:35.048288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:33:35.048288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4930060-ddb1-4835-a231-ea79ffb14068 could not be found. Sep 19 12:33:35.048288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:35.048288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:35.048288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:35.048288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:35.048288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:35.048288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:35.048288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:33:35.048288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:33:35.048288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4930060-ddb1-4835-a231-ea79ffb14068 could not be found. Sep 19 12:33:35.048288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:35.050489 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e4dbfa1e-0967-4b32-9b22-c11d6f4bdb75 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] Returning 404 to user: Instance a4930060-ddb1-4835-a231-ea79ffb14068 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:33:35.051769 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e4dbfa1e-0967-4b32-9b22-c11d6f4bdb75 tempest-AttachVolumeNegativeTest-1505595249 tempest-AttachVolumeNegativeTest-1505595249-project] 10.222.0.93 "GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068" status: 404 len: 111 microversion: 2.1 time: 0.041306 Sep 19 12:33:35.056867 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 348/696] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:35 2022] GET /compute/v2.1/servers/a4930060-ddb1-4835-a231-ea79ffb14068 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 12:33:35.968014 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-33654c63-439b-4352-b7bb-9126628b54ef tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:35.968726 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-33654c63-439b-4352-b7bb-9126628b54ef tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:35.980998 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33654c63-439b-4352-b7bb-9126628b54ef tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:35.981620 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33654c63-439b-4352-b7bb-9126628b54ef tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:35.982190 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33654c63-439b-4352-b7bb-9126628b54ef tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:35.983006 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33654c63-439b-4352-b7bb-9126628b54ef tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:35.984674 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33654c63-439b-4352-b7bb-9126628b54ef tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:35.985591 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33654c63-439b-4352-b7bb-9126628b54ef tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:36.222732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-33654c63-439b-4352-b7bb-9126628b54ef tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:36.233440 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-33654c63-439b-4352-b7bb-9126628b54ef tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:36.235110 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-33654c63-439b-4352-b7bb-9126628b54ef tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:36.236679 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-33654c63-439b-4352-b7bb-9126628b54ef tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1741 microversion: 2.20 time: 0.272339 Sep 19 12:33:36.241132 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 349/697] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:35 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1741 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:37.263074 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f6e9e4d1-9db8-4944-871d-4dc71d2f1b59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:37.264567 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f6e9e4d1-9db8-4944-871d-4dc71d2f1b59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:37.274247 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f6e9e4d1-9db8-4944-871d-4dc71d2f1b59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:37.275099 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f6e9e4d1-9db8-4944-871d-4dc71d2f1b59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:37.276206 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f6e9e4d1-9db8-4944-871d-4dc71d2f1b59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:37.286220 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f6e9e4d1-9db8-4944-871d-4dc71d2f1b59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:37.287281 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f6e9e4d1-9db8-4944-871d-4dc71d2f1b59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:37.287933 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f6e9e4d1-9db8-4944-871d-4dc71d2f1b59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:37.456584 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f6e9e4d1-9db8-4944-871d-4dc71d2f1b59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:37.483277 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f6e9e4d1-9db8-4944-871d-4dc71d2f1b59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:37.490206 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f6e9e4d1-9db8-4944-871d-4dc71d2f1b59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:37.491859 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f6e9e4d1-9db8-4944-871d-4dc71d2f1b59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1741 microversion: 2.20 time: 0.233262 Sep 19 12:33:37.492690 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 349/698] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:37 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1741 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:38.524010 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-fe1985a2-c595-4b3f-a679-48d1849a56dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:38.525337 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-fe1985a2-c595-4b3f-a679-48d1849a56dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:38.533851 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fe1985a2-c595-4b3f-a679-48d1849a56dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:38.534570 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fe1985a2-c595-4b3f-a679-48d1849a56dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:38.535165 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fe1985a2-c595-4b3f-a679-48d1849a56dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:38.536891 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fe1985a2-c595-4b3f-a679-48d1849a56dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:38.537524 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fe1985a2-c595-4b3f-a679-48d1849a56dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:38.538114 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fe1985a2-c595-4b3f-a679-48d1849a56dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:38.910913 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-fe1985a2-c595-4b3f-a679-48d1849a56dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:38.935658 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-fe1985a2-c595-4b3f-a679-48d1849a56dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:38.942117 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-fe1985a2-c595-4b3f-a679-48d1849a56dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:38.950691 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-fe1985a2-c595-4b3f-a679-48d1849a56dd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1741 microversion: 2.20 time: 0.431095 Sep 19 12:33:38.954383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 350/699] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:38 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1741 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:40.002115 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-3c4c3b24-0c26-447a-b4aa-83ad72828b8d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:40.003364 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-3c4c3b24-0c26-447a-b4aa-83ad72828b8d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:40.010578 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3c4c3b24-0c26-447a-b4aa-83ad72828b8d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:40.011474 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3c4c3b24-0c26-447a-b4aa-83ad72828b8d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:40.011787 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3c4c3b24-0c26-447a-b4aa-83ad72828b8d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:40.012767 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3c4c3b24-0c26-447a-b4aa-83ad72828b8d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:40.013515 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3c4c3b24-0c26-447a-b4aa-83ad72828b8d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:40.014196 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3c4c3b24-0c26-447a-b4aa-83ad72828b8d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:40.557327 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-3c4c3b24-0c26-447a-b4aa-83ad72828b8d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:40.557327 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-3c4c3b24-0c26-447a-b4aa-83ad72828b8d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:40.558597 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-3c4c3b24-0c26-447a-b4aa-83ad72828b8d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:40.558597 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-3c4c3b24-0c26-447a-b4aa-83ad72828b8d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1741 microversion: 2.20 time: 0.420521 Sep 19 12:33:40.558597 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 350/700] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:39 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1741 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:41.452752 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3766c5d5-06b8-4ab3-9553-834ed5c001c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:41.453534 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3766c5d5-06b8-4ab3-9553-834ed5c001c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:41.460931 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3766c5d5-06b8-4ab3-9553-834ed5c001c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:41.461745 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3766c5d5-06b8-4ab3-9553-834ed5c001c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:41.462349 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3766c5d5-06b8-4ab3-9553-834ed5c001c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:41.463810 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3766c5d5-06b8-4ab3-9553-834ed5c001c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:41.464429 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3766c5d5-06b8-4ab3-9553-834ed5c001c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:41.465286 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3766c5d5-06b8-4ab3-9553-834ed5c001c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:41.643097 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3766c5d5-06b8-4ab3-9553-834ed5c001c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:41.654278 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3766c5d5-06b8-4ab3-9553-834ed5c001c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:41.659551 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3766c5d5-06b8-4ab3-9553-834ed5c001c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:41.659551 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3766c5d5-06b8-4ab3-9553-834ed5c001c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1741 microversion: 2.20 time: 0.213561 Sep 19 12:33:41.659551 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 351/701] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:41 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1741 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:42.686671 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f37f583a-1883-4719-a773-be6eb88382d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:42.688007 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f37f583a-1883-4719-a773-be6eb88382d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:42.701974 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f37f583a-1883-4719-a773-be6eb88382d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:42.703065 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f37f583a-1883-4719-a773-be6eb88382d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:42.703739 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f37f583a-1883-4719-a773-be6eb88382d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:42.704849 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f37f583a-1883-4719-a773-be6eb88382d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:42.705485 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f37f583a-1883-4719-a773-be6eb88382d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:42.706087 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f37f583a-1883-4719-a773-be6eb88382d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:42.886835 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f37f583a-1883-4719-a773-be6eb88382d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:42.895739 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f37f583a-1883-4719-a773-be6eb88382d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:42.897235 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f37f583a-1883-4719-a773-be6eb88382d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:42.898434 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f37f583a-1883-4719-a773-be6eb88382d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1741 microversion: 2.20 time: 0.215704 Sep 19 12:33:42.899000 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 351/702] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:42 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1741 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:43.927714 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-5a7d6fe0-dafd-4203-9448-247f860cf358 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:43.928352 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-5a7d6fe0-dafd-4203-9448-247f860cf358 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:43.941250 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:43.946946 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5a7d6fe0-dafd-4203-9448-247f860cf358 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:43.947511 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5a7d6fe0-dafd-4203-9448-247f860cf358 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:43.948024 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5a7d6fe0-dafd-4203-9448-247f860cf358 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:43.948930 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5a7d6fe0-dafd-4203-9448-247f860cf358 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:43.949907 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5a7d6fe0-dafd-4203-9448-247f860cf358 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:43.950903 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5a7d6fe0-dafd-4203-9448-247f860cf358 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:44.046364 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4b9e9f51-1a51-4a02-a07c-f8c3e53d542c tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] Action: 'create', calling method: .version_select at 0x7f54b34cf5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-847913328", "metadata": {"Type": "work"}}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4b9e9f51-1a51-4a02-a07c-f8c3e53d542c tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] Request method failure captured: Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 121 Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKGGnPibA4o5tCrzP73Utn6iMO557T9SGSaturp_AdKNqH1YnHTQytIW1Spr_Rw8EAsNHXlrMXtTq8kr_T_MeL-TjIlGXOSPAvfJcwM49cItLag6csdhOdYPnWE6dglA2E1jjY3H3m2ZLDNCjVnF8UlDF5irPKg6V4LoiAotG3NqMKkU Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: a4fd24c188234ff0a3048caeb3cc8ad0 Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-VolumesNegativeTest-534710536 Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:33:44.058178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:33:44.062537 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4fd24c188234ff0a3048caeb3cc8ad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a4fd24c188234ff0a3048caeb3cc8ad0", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4fd24c188234ff0a3048caeb3cc8ad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a4fd24c188234ff0a3048caeb3cc8ad0"}]}] Sep 19 12:33:44.062537 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-VolumesNegativeTest-534710536 Sep 19 12:33:44.062537 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: a4fd24c188234ff0a3048caeb3cc8ad0 Sep 19 12:33:44.062537 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-VolumesNegativeTest-534710536 Sep 19 12:33:44.062537 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-VolumesNegativeTest-534710536-project Sep 19 12:33:44.062537 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:33:44.062537 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:33:44.062537 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: d63eef9db9c847d38b2644b72e307aa1 Sep 19 12:33:44.062537 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-VolumesNegativeTest-534710536-project Sep 19 12:33:44.062537 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Sep 19 12:33:44.062537 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-847913328", "metadata": {"Type": "work"}}} Sep 19 12:33:44.062537 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: Sep 19 12:33:44.062537 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-847913328', 'metadata': {'Type': 'work'}}}} Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise error Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi '#$%' Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:33:44.063375 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:33:44.065036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 12:33:44.065036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 12:33:44.065036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:33:44.065036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:33:44.065036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 12:33:44.065036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 12:33:44.065036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 12:33:44.065036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 12:33:44.065036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 12:33:44.065036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 12:33:44.065036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 12:33:44.065036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.065036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:44.065036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.065036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.065036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:44.065036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:44.065036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 12:33:44.065036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 12:33:44.066481 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 12:33:44.066481 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.066481 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4b9e9f51-1a51-4a02-a07c-f8c3e53d542c tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:33:44.066481 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4b9e9f51-1a51-4a02-a07c-f8c3e53d542c tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.189974 Sep 19 12:33:44.066481 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 352/703] 10.222.0.93 () {60 vars in 1156 bytes} [Mon Sep 19 12:33:43 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:33:44.075200 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-84e1a07a-76f5-4c04-bda3-f4bd3c038f18 tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] Action: 'create', calling method: .version_select at 0x7f54b32f91f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1163334027", "metadata": {"Type": "work"}}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-84e1a07a-76f5-4c04-bda3-f4bd3c038f18 tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] Request method failure captured: Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 120 Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKGGnPibA4o5tCrzP73Utn6iMO557T9SGSaturp_AdKNqH1YnHTQytIW1Spr_Rw8EAsNHXlrMXtTq8kr_T_MeL-TjIlGXOSPAvfJcwM49cItLag6csdhOdYPnWE6dglA2E1jjY3H3m2ZLDNCjVnF8UlDF5irPKg6V4LoiAotG3NqMKkU Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: a4fd24c188234ff0a3048caeb3cc8ad0 Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-VolumesNegativeTest-534710536 Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:33:44.097785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:33:44.099322 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4fd24c188234ff0a3048caeb3cc8ad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a4fd24c188234ff0a3048caeb3cc8ad0", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4fd24c188234ff0a3048caeb3cc8ad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a4fd24c188234ff0a3048caeb3cc8ad0"}]}] Sep 19 12:33:44.099322 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-VolumesNegativeTest-534710536 Sep 19 12:33:44.099322 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: a4fd24c188234ff0a3048caeb3cc8ad0 Sep 19 12:33:44.099322 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-VolumesNegativeTest-534710536 Sep 19 12:33:44.099322 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-VolumesNegativeTest-534710536-project Sep 19 12:33:44.099322 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:33:44.099322 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:33:44.099322 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: d63eef9db9c847d38b2644b72e307aa1 Sep 19 12:33:44.099322 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-VolumesNegativeTest-534710536-project Sep 19 12:33:44.099322 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Sep 19 12:33:44.099322 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1163334027", "metadata": {"Type": "work"}}} Sep 19 12:33:44.099322 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: Sep 19 12:33:44.099322 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1163334027', 'metadata': {'Type': 'work'}}}} Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise error Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi '0' Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:33:44.100370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:33:44.101746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 12:33:44.101746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 12:33:44.101746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:33:44.101746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:33:44.101746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 12:33:44.101746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 12:33:44.101746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 12:33:44.101746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 12:33:44.101746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 12:33:44.101746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 12:33:44.101746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 12:33:44.101746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.101746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:44.101746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.101746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.101746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:44.101746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:44.101746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 12:33:44.101746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 12:33:44.103075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 12:33:44.103075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.105201 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-84e1a07a-76f5-4c04-bda3-f4bd3c038f18 tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:33:44.106562 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-84e1a07a-76f5-4c04-bda3-f4bd3c038f18 tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.035791 Sep 19 12:33:44.107445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 353/704] 10.222.0.93 () {60 vars in 1156 bytes} [Mon Sep 19 12:33:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 12:33:44.122855 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-891981f6-123b-420e-a36c-2bf0a32aeafd tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] Action: 'create', calling method: .version_select at 0x7f54b3340280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1861377831", "metadata": {"Type": "work"}}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-891981f6-123b-420e-a36c-2bf0a32aeafd tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] Request method failure captured: Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 119 Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKGGnPibA4o5tCrzP73Utn6iMO557T9SGSaturp_AdKNqH1YnHTQytIW1Spr_Rw8EAsNHXlrMXtTq8kr_T_MeL-TjIlGXOSPAvfJcwM49cItLag6csdhOdYPnWE6dglA2E1jjY3H3m2ZLDNCjVnF8UlDF5irPKg6V4LoiAotG3NqMKkU Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: a4fd24c188234ff0a3048caeb3cc8ad0 Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-VolumesNegativeTest-534710536 Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:33:44.129903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:33:44.131649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4fd24c188234ff0a3048caeb3cc8ad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a4fd24c188234ff0a3048caeb3cc8ad0", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4fd24c188234ff0a3048caeb3cc8ad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a4fd24c188234ff0a3048caeb3cc8ad0"}]}] Sep 19 12:33:44.131649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-VolumesNegativeTest-534710536 Sep 19 12:33:44.131649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: a4fd24c188234ff0a3048caeb3cc8ad0 Sep 19 12:33:44.131649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-VolumesNegativeTest-534710536 Sep 19 12:33:44.131649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-VolumesNegativeTest-534710536-project Sep 19 12:33:44.131649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:33:44.131649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:33:44.131649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: d63eef9db9c847d38b2644b72e307aa1 Sep 19 12:33:44.131649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-VolumesNegativeTest-534710536-project Sep 19 12:33:44.131649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Sep 19 12:33:44.131649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1861377831", "metadata": {"Type": "work"}}} Sep 19 12:33:44.131649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: Sep 19 12:33:44.131649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1861377831', 'metadata': {'Type': 'work'}}}} Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise error Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi '' Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:33:44.132979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:33:44.135259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 12:33:44.135259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 12:33:44.135259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:33:44.135259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:33:44.135259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 12:33:44.135259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 12:33:44.135259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 12:33:44.135259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 12:33:44.135259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 12:33:44.135259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 12:33:44.135259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 12:33:44.135259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.135259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:44.135259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.135259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.135259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:44.135259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:44.135259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 12:33:44.135259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 12:33:44.136839 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 12:33:44.136839 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.137030 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5a7d6fe0-dafd-4203-9448-247f860cf358 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:44.138152 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-891981f6-123b-420e-a36c-2bf0a32aeafd tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:33:44.139393 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-891981f6-123b-420e-a36c-2bf0a32aeafd tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021488 Sep 19 12:33:44.143057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5a7d6fe0-dafd-4203-9448-247f860cf358 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:44.143488 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 354/705] 10.222.0.93 () {60 vars in 1156 bytes} [Mon Sep 19 12:33:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:33:44.144541 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5a7d6fe0-dafd-4203-9448-247f860cf358 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:44.148304 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-5a7d6fe0-dafd-4203-9448-247f860cf358 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1741 microversion: 2.20 time: 0.225317 Sep 19 12:33:44.156218 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-f4f7056a-ef6a-480f-9359-5b895ce20bbe tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] Calling method '.version_select at 0x7f54b336f9d0>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:44.165125 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 352/706] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:43 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1741 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:44.205226 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-f4f7056a-ef6a-480f-9359-5b895ce20bbe tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] HTTP exception thrown: Volume tempest-invalid-1667665589 could not be found. Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-f4f7056a-ef6a-480f-9359-5b895ce20bbe tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] Request method failure captured: Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1667665589 HTTP/1.1 Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKGGnPibA4o5tCrzP73Utn6iMO557T9SGSaturp_AdKNqH1YnHTQytIW1Spr_Rw8EAsNHXlrMXtTq8kr_T_MeL-TjIlGXOSPAvfJcwM49cItLag6csdhOdYPnWE6dglA2E1jjY3H3m2ZLDNCjVnF8UlDF5irPKg6V4LoiAotG3NqMKkU Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: a4fd24c188234ff0a3048caeb3cc8ad0 Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-VolumesNegativeTest-534710536 Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:33:44.207958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:33:44.209719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4fd24c188234ff0a3048caeb3cc8ad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a4fd24c188234ff0a3048caeb3cc8ad0", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4fd24c188234ff0a3048caeb3cc8ad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a4fd24c188234ff0a3048caeb3cc8ad0"}]}] Sep 19 12:33:44.209719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-VolumesNegativeTest-534710536 Sep 19 12:33:44.209719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: a4fd24c188234ff0a3048caeb3cc8ad0 Sep 19 12:33:44.209719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-VolumesNegativeTest-534710536 Sep 19 12:33:44.209719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-VolumesNegativeTest-534710536-project Sep 19 12:33:44.209719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:33:44.209719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:33:44.209719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: d63eef9db9c847d38b2644b72e307aa1 Sep 19 12:33:44.209719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-VolumesNegativeTest-534710536-project Sep 19 12:33:44.209719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: Sep 19 12:33:44.209719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Volume tempest-invalid-1667665589 could not be found. Sep 19 12:33:44.209719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': 'tempest-invalid-1667665589'} Sep 19 12:33:44.209719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:33:44.210730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.210730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 12:33:44.210730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 12:33:44.210730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 12:33:44.210730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 12:33:44.210730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 12:33:44.210730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 12:33:44.210730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 12:33:44.210730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 12:33:44.210730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 12:33:44.210730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 12:33:44.210730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 12:33:44.210730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 12:33:44.210730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 12:33:44.210730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 12:33:44.210730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1667665589 could not be found. (HTTP 404) (Request-ID: req-fef43c7a-724c-4b38-bfbc-be6e8971243a) Sep 19 12:33:44.210730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.210730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:44.210730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.213526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.213526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 12:33:44.213526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 12:33:44.213526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 12:33:44.213526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 12:33:44.213526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 12:33:44.213526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 12:33:44.213526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 12:33:44.213526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 12:33:44.213526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 12:33:44.213526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 12:33:44.213526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 12:33:44.213526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 12:33:44.213526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 12:33:44.213526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 12:33:44.213526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 12:33:44.213526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 12:33:44.213526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 12:33:44.213526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1667665589 could not be found. Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:33:44.214801 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1667665589 could not be found. Sep 19 12:33:44.216094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.216094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:44.216094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.216094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.216094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:44.216094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:44.216094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:33:44.216094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:33:44.216094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1667665589 could not be found. Sep 19 12:33:44.216094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.216094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-f4f7056a-ef6a-480f-9359-5b895ce20bbe tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] Returning 404 to user: Volume tempest-invalid-1667665589 could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:33:44.216094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-f4f7056a-ef6a-480f-9359-5b895ce20bbe tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1667665589" status: 404 len: 99 microversion: 2.1 time: 0.060762 Sep 19 12:33:44.216094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 355/707] 10.222.0.93 () {58 vars in 1218 bytes} [Mon Sep 19 12:33:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1667665589 => generated 99 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 12:33:44.224117 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-41eea567-52fa-4d1c-b8b3-0e7b21de44a2 tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004974 Sep 19 12:33:44.225321 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 353/708] 10.222.0.93 () {58 vars in 1140 bytes} [Mon Sep 19 12:33:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 19 12:33:44.235576 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-71bf0921-6064-43cd-8416-9298a7407992 tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004624 Sep 19 12:33:44.236284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 356/709] 10.222.0.93 () {58 vars in 1137 bytes} [Mon Sep 19 12:33:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 19 12:33:44.245789 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b2dbb947-02c1-4164-b192-6e37c7545ce0 tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] Calling method '.version_select at 0x7f54b361daf0>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:44.285050 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-b2dbb947-02c1-4164-b192-6e37c7545ce0 tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] HTTP exception thrown: Volume 40a8d0ea-cefc-4c47-81e2-8fd9c1e1f69d could not be found. Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b2dbb947-02c1-4164-b192-6e37c7545ce0 tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] Request method failure captured: Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: DELETE /compute/v2.1/os-volumes/40a8d0ea-cefc-4c47-81e2-8fd9c1e1f69d HTTP/1.1 Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKGGnPibA4o5tCrzP73Utn6iMO557T9SGSaturp_AdKNqH1YnHTQytIW1Spr_Rw8EAsNHXlrMXtTq8kr_T_MeL-TjIlGXOSPAvfJcwM49cItLag6csdhOdYPnWE6dglA2E1jjY3H3m2ZLDNCjVnF8UlDF5irPKg6V4LoiAotG3NqMKkU Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: a4fd24c188234ff0a3048caeb3cc8ad0 Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-VolumesNegativeTest-534710536 Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:33:44.285571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:33:44.287685 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4fd24c188234ff0a3048caeb3cc8ad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a4fd24c188234ff0a3048caeb3cc8ad0", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4fd24c188234ff0a3048caeb3cc8ad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a4fd24c188234ff0a3048caeb3cc8ad0"}]}] Sep 19 12:33:44.287685 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-VolumesNegativeTest-534710536 Sep 19 12:33:44.287685 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: a4fd24c188234ff0a3048caeb3cc8ad0 Sep 19 12:33:44.287685 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-VolumesNegativeTest-534710536 Sep 19 12:33:44.287685 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-VolumesNegativeTest-534710536-project Sep 19 12:33:44.287685 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:33:44.287685 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:33:44.287685 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: d63eef9db9c847d38b2644b72e307aa1 Sep 19 12:33:44.287685 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-VolumesNegativeTest-534710536-project Sep 19 12:33:44.287685 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: Sep 19 12:33:44.287685 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Volume 40a8d0ea-cefc-4c47-81e2-8fd9c1e1f69d could not be found. Sep 19 12:33:44.287685 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': '40a8d0ea-cefc-4c47-81e2-8fd9c1e1f69d'} Sep 19 12:33:44.287685 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:33:44.288696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.288696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 12:33:44.288696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 12:33:44.288696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 12:33:44.288696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 12:33:44.288696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 12:33:44.288696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 12:33:44.288696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 12:33:44.288696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 12:33:44.288696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 12:33:44.288696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 12:33:44.288696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 12:33:44.288696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 12:33:44.288696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 12:33:44.288696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 12:33:44.288696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 40a8d0ea-cefc-4c47-81e2-8fd9c1e1f69d could not be found. (HTTP 404) (Request-ID: req-41cb832d-ed94-40ba-a1de-9a57c0d88859) Sep 19 12:33:44.288696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.288696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:44.288696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.290893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.290893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 12:33:44.290893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 12:33:44.290893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 12:33:44.290893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 12:33:44.290893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 12:33:44.290893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 12:33:44.290893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 12:33:44.290893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 12:33:44.290893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 12:33:44.290893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 12:33:44.290893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 12:33:44.290893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 12:33:44.290893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 12:33:44.290893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 12:33:44.290893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 12:33:44.290893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 12:33:44.290893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 12:33:44.290893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 12:33:44.293120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 12:33:44.293120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 12:33:44.293120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 12:33:44.293120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 12:33:44.293120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 40a8d0ea-cefc-4c47-81e2-8fd9c1e1f69d could not be found. Sep 19 12:33:44.293120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.293120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:44.293120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.293120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.293120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:44.293120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:44.293120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:33:44.293120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:33:44.293120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 12:33:44.293120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 12:33:44.293120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:33:44.293120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:33:44.293120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 12:33:44.293120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:33:44.295085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 40a8d0ea-cefc-4c47-81e2-8fd9c1e1f69d could not be found. Sep 19 12:33:44.295085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.295085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:44.295085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.295085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.295085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:44.295085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:44.295085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:33:44.295085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:33:44.295085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 40a8d0ea-cefc-4c47-81e2-8fd9c1e1f69d could not be found. Sep 19 12:33:44.295085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.295085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b2dbb947-02c1-4164-b192-6e37c7545ce0 tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] Returning 404 to user: Volume 40a8d0ea-cefc-4c47-81e2-8fd9c1e1f69d could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:33:44.295085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-b2dbb947-02c1-4164-b192-6e37c7545ce0 tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/40a8d0ea-cefc-4c47-81e2-8fd9c1e1f69d" status: 404 len: 109 microversion: 2.1 time: 0.045145 Sep 19 12:33:44.295085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 354/710] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Sep 19 12:33:44 2022] DELETE /compute/v2.1/os-volumes/40a8d0ea-cefc-4c47-81e2-8fd9c1e1f69d => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:33:44.301055 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e46b143f-e228-4632-8340-8c0e335852cb tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] Calling method '.version_select at 0x7f54b34cfc10>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:44.334919 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-e46b143f-e228-4632-8340-8c0e335852cb tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] HTTP exception thrown: Volume 4fe1b89a-10f4-4006-9ac5-05761bf5639c could not be found. Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e46b143f-e228-4632-8340-8c0e335852cb tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] Request method failure captured: Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: GET /compute/v2.1/os-volumes/4fe1b89a-10f4-4006-9ac5-05761bf5639c HTTP/1.1 Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKGGnPibA4o5tCrzP73Utn6iMO557T9SGSaturp_AdKNqH1YnHTQytIW1Spr_Rw8EAsNHXlrMXtTq8kr_T_MeL-TjIlGXOSPAvfJcwM49cItLag6csdhOdYPnWE6dglA2E1jjY3H3m2ZLDNCjVnF8UlDF5irPKg6V4LoiAotG3NqMKkU Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: a4fd24c188234ff0a3048caeb3cc8ad0 Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-VolumesNegativeTest-534710536 Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:33:44.338585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:33:44.341385 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4fd24c188234ff0a3048caeb3cc8ad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a4fd24c188234ff0a3048caeb3cc8ad0", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4fd24c188234ff0a3048caeb3cc8ad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a4fd24c188234ff0a3048caeb3cc8ad0"}]}] Sep 19 12:33:44.341385 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-VolumesNegativeTest-534710536 Sep 19 12:33:44.341385 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: a4fd24c188234ff0a3048caeb3cc8ad0 Sep 19 12:33:44.341385 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-VolumesNegativeTest-534710536 Sep 19 12:33:44.341385 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-VolumesNegativeTest-534710536-project Sep 19 12:33:44.341385 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:33:44.341385 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:33:44.341385 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: d63eef9db9c847d38b2644b72e307aa1 Sep 19 12:33:44.341385 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-VolumesNegativeTest-534710536-project Sep 19 12:33:44.341385 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: Sep 19 12:33:44.341385 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Volume 4fe1b89a-10f4-4006-9ac5-05761bf5639c could not be found. Sep 19 12:33:44.341385 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': '4fe1b89a-10f4-4006-9ac5-05761bf5639c'} Sep 19 12:33:44.341385 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:33:44.344959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.344959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 12:33:44.344959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 12:33:44.344959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 12:33:44.344959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 12:33:44.344959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 12:33:44.344959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 12:33:44.344959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 12:33:44.344959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 12:33:44.344959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 12:33:44.344959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 12:33:44.344959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 12:33:44.344959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 12:33:44.344959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 12:33:44.344959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 12:33:44.344959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4fe1b89a-10f4-4006-9ac5-05761bf5639c could not be found. (HTTP 404) (Request-ID: req-209c525c-63c1-4c43-91b6-0954793c0773) Sep 19 12:33:44.344959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.344959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:44.344959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.348503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.348503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 12:33:44.348503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 12:33:44.348503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 12:33:44.348503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 12:33:44.348503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 12:33:44.348503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 12:33:44.348503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 12:33:44.348503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 12:33:44.348503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 12:33:44.348503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 12:33:44.348503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 12:33:44.348503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 12:33:44.348503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 12:33:44.348503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 12:33:44.348503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 12:33:44.348503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 12:33:44.348503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 12:33:44.348503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 12:33:44.350067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 12:33:44.350067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 12:33:44.350067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 12:33:44.350067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 12:33:44.350067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4fe1b89a-10f4-4006-9ac5-05761bf5639c could not be found. Sep 19 12:33:44.350067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.350067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:44.350067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.350067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.350067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:44.350067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:44.350067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:33:44.350067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:33:44.350067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 12:33:44.350067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 12:33:44.350067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:33:44.350067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:33:44.350067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 12:33:44.350067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:33:44.351656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4fe1b89a-10f4-4006-9ac5-05761bf5639c could not be found. Sep 19 12:33:44.351656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.351656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:44.351656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.351656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:44.351656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:44.351656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:44.351656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:33:44.351656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:33:44.351656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4fe1b89a-10f4-4006-9ac5-05761bf5639c could not be found. Sep 19 12:33:44.351656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:33:44.351656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e46b143f-e228-4632-8340-8c0e335852cb tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] Returning 404 to user: Volume 4fe1b89a-10f4-4006-9ac5-05761bf5639c could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:33:44.351656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e46b143f-e228-4632-8340-8c0e335852cb tempest-VolumesNegativeTest-534710536 tempest-VolumesNegativeTest-534710536-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/4fe1b89a-10f4-4006-9ac5-05761bf5639c" status: 404 len: 109 microversion: 2.1 time: 0.047558 Sep 19 12:33:44.351656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 357/711] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Sep 19 12:33:44 2022] GET /compute/v2.1/os-volumes/4fe1b89a-10f4-4006-9ac5-05761bf5639c => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:33:45.176654 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-825a841e-f4de-4848-ae28-1795cd1e6360 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:45.177240 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-825a841e-f4de-4848-ae28-1795cd1e6360 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:45.189232 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-825a841e-f4de-4848-ae28-1795cd1e6360 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:45.190490 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-825a841e-f4de-4848-ae28-1795cd1e6360 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:45.191714 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-825a841e-f4de-4848-ae28-1795cd1e6360 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:45.192723 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-825a841e-f4de-4848-ae28-1795cd1e6360 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:45.193590 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-825a841e-f4de-4848-ae28-1795cd1e6360 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:45.194163 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-825a841e-f4de-4848-ae28-1795cd1e6360 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:45.367907 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-825a841e-f4de-4848-ae28-1795cd1e6360 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:45.374196 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-825a841e-f4de-4848-ae28-1795cd1e6360 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:45.375678 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-825a841e-f4de-4848-ae28-1795cd1e6360 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:45.376942 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-825a841e-f4de-4848-ae28-1795cd1e6360 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1741 microversion: 2.20 time: 0.205390 Sep 19 12:33:45.377508 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 355/712] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:45 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1741 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:46.407997 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9cd4e27e-4820-4c42-b8b6-47ba6bcaa14f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:46.408636 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9cd4e27e-4820-4c42-b8b6-47ba6bcaa14f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:46.410544 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:46.415345 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9cd4e27e-4820-4c42-b8b6-47ba6bcaa14f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:46.415947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9cd4e27e-4820-4c42-b8b6-47ba6bcaa14f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:46.416385 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9cd4e27e-4820-4c42-b8b6-47ba6bcaa14f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:46.417112 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9cd4e27e-4820-4c42-b8b6-47ba6bcaa14f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:46.417559 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9cd4e27e-4820-4c42-b8b6-47ba6bcaa14f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:46.417977 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9cd4e27e-4820-4c42-b8b6-47ba6bcaa14f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:46.557225 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9cd4e27e-4820-4c42-b8b6-47ba6bcaa14f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:46.565411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9cd4e27e-4820-4c42-b8b6-47ba6bcaa14f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:46.566868 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9cd4e27e-4820-4c42-b8b6-47ba6bcaa14f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:46.568032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9cd4e27e-4820-4c42-b8b6-47ba6bcaa14f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1741 microversion: 2.20 time: 0.165493 Sep 19 12:33:46.568591 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 358/713] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:46 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:33:47.237758 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-64553389-2ce3-435d-864e-dfcf315f6192 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-425080789", "imageRef": "d4301833-8e96-46bf-a940-692f93f7fdba", "flavorRef": "452"}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:33:47.299503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.network.neutron [None req-64553389-2ce3-435d-864e-dfcf315f6192 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] validate_networks() for None {{(pid=121428) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:33:47.595138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c2669531-f181-4fff-99fb-e61b428701a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:47.595877 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c2669531-f181-4fff-99fb-e61b428701a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:47.604467 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c2669531-f181-4fff-99fb-e61b428701a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:47.605134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c2669531-f181-4fff-99fb-e61b428701a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:47.612542 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c2669531-f181-4fff-99fb-e61b428701a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:47.612542 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c2669531-f181-4fff-99fb-e61b428701a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:47.612542 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c2669531-f181-4fff-99fb-e61b428701a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:47.612542 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c2669531-f181-4fff-99fb-e61b428701a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:47.743549 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-64553389-2ce3-435d-864e-dfcf315f6192 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Flavor limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:33:47.744057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-64553389-2ce3-435d-864e-dfcf315f6192 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Image limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:33:47.744528 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-64553389-2ce3-435d-864e-dfcf315f6192 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Flavor pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:33:47.745524 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-64553389-2ce3-435d-864e-dfcf315f6192 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Image pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:33:47.746101 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-64553389-2ce3-435d-864e-dfcf315f6192 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:33:47.754998 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-64553389-2ce3-435d-864e-dfcf315f6192 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:47.755665 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-64553389-2ce3-435d-864e-dfcf315f6192 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:47.756244 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-64553389-2ce3-435d-864e-dfcf315f6192 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:47.757043 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-64553389-2ce3-435d-864e-dfcf315f6192 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:47.761484 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-64553389-2ce3-435d-864e-dfcf315f6192 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:47.761484 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-64553389-2ce3-435d-864e-dfcf315f6192 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:47.781850 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-64553389-2ce3-435d-864e-dfcf315f6192 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Getting quotas for project 37d13fe0d14347878b8947fcee1767ef. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:33:47.786805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-64553389-2ce3-435d-864e-dfcf315f6192 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Getting quotas for user 36221e0d7016479396e25381d80a26ed and project 37d13fe0d14347878b8947fcee1767ef. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:33:47.800526 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-64553389-2ce3-435d-864e-dfcf315f6192 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Going to run 1 instances... {{(pid=121428) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:33:47.803179 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-64553389-2ce3-435d-864e-dfcf315f6192 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4301833-8e96-46bf-a940-692f93f7fdba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:33:47.871036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c2669531-f181-4fff-99fb-e61b428701a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:47.880173 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c2669531-f181-4fff-99fb-e61b428701a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:47.884299 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c2669531-f181-4fff-99fb-e61b428701a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:47.884299 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c2669531-f181-4fff-99fb-e61b428701a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1723 microversion: 2.20 time: 0.292650 Sep 19 12:33:47.884299 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 359/714] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:47 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:33:47.995231 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-64553389-2ce3-435d-864e-dfcf315f6192 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762527 Sep 19 12:33:47.995879 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 356/715] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:33:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:33:48.007323 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-93c56f87-6061-4540-ae95-671a829523cb tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:48.008723 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-93c56f87-6061-4540-ae95-671a829523cb tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:48.072682 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-93c56f87-6061-4540-ae95-671a829523cb tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:48.078034 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-93c56f87-6061-4540-ae95-671a829523cb tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1214 microversion: 2.1 time: 0.074441 Sep 19 12:33:48.079109 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 360/716] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:48 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:48.917217 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f094732b-adbc-49be-89f2-c0ee49f64191 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:48.917217 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f094732b-adbc-49be-89f2-c0ee49f64191 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:48.917834 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f094732b-adbc-49be-89f2-c0ee49f64191 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:48.918164 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f094732b-adbc-49be-89f2-c0ee49f64191 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:48.918592 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f094732b-adbc-49be-89f2-c0ee49f64191 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:48.919281 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f094732b-adbc-49be-89f2-c0ee49f64191 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:48.919757 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f094732b-adbc-49be-89f2-c0ee49f64191 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:48.920175 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f094732b-adbc-49be-89f2-c0ee49f64191 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:49.057088 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f094732b-adbc-49be-89f2-c0ee49f64191 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:49.065584 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f094732b-adbc-49be-89f2-c0ee49f64191 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:49.067159 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f094732b-adbc-49be-89f2-c0ee49f64191 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:49.068358 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f094732b-adbc-49be-89f2-c0ee49f64191 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1723 microversion: 2.20 time: 0.162851 Sep 19 12:33:49.069047 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 357/717] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:48 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:49.100589 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e663a531-c682-4fea-a0d0-babf8f5d2a83 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:49.101241 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-e663a531-c682-4fea-a0d0-babf8f5d2a83 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:49.158912 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e663a531-c682-4fea-a0d0-babf8f5d2a83 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:49.167502 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e663a531-c682-4fea-a0d0-babf8f5d2a83 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1214 microversion: 2.1 time: 0.070875 Sep 19 12:33:49.168094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 361/718] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:49 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:50.095499 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f2101658-f46b-4a84-8380-bbf401d83a85 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:50.096155 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f2101658-f46b-4a84-8380-bbf401d83a85 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:50.102955 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f2101658-f46b-4a84-8380-bbf401d83a85 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:50.103702 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f2101658-f46b-4a84-8380-bbf401d83a85 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:50.103952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f2101658-f46b-4a84-8380-bbf401d83a85 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:50.104734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f2101658-f46b-4a84-8380-bbf401d83a85 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:50.105192 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f2101658-f46b-4a84-8380-bbf401d83a85 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:50.105618 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f2101658-f46b-4a84-8380-bbf401d83a85 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:50.192031 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-83497a20-cff7-4815-ba29-4ec18cd33a06 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:50.192944 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-83497a20-cff7-4815-ba29-4ec18cd33a06 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:50.201442 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-83497a20-cff7-4815-ba29-4ec18cd33a06 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:50.201994 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-83497a20-cff7-4815-ba29-4ec18cd33a06 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:50.202434 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-83497a20-cff7-4815-ba29-4ec18cd33a06 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:50.203325 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-83497a20-cff7-4815-ba29-4ec18cd33a06 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:50.203790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-83497a20-cff7-4815-ba29-4ec18cd33a06 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:50.204504 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-83497a20-cff7-4815-ba29-4ec18cd33a06 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:50.289999 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f2101658-f46b-4a84-8380-bbf401d83a85 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:50.293916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-83497a20-cff7-4815-ba29-4ec18cd33a06 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:50.303059 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-83497a20-cff7-4815-ba29-4ec18cd33a06 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1266 microversion: 2.1 time: 0.115411 Sep 19 12:33:50.303648 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 362/719] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:50 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1266 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:50.308652 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f2101658-f46b-4a84-8380-bbf401d83a85 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:50.310321 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f2101658-f46b-4a84-8380-bbf401d83a85 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:50.311824 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f2101658-f46b-4a84-8380-bbf401d83a85 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1726 microversion: 2.20 time: 0.220501 Sep 19 12:33:50.312477 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 358/720] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:50 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:50.340504 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ab8ed73c-adf2-4a82-87db-58e0495c8302 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8473465-ed74-464e-ad5f-c29f9bd927d6"}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:33:50.344245 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ab8ed73c-adf2-4a82-87db-58e0495c8302 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:50.355570 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ab8ed73c-adf2-4a82-87db-58e0495c8302 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:50.356092 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ab8ed73c-adf2-4a82-87db-58e0495c8302 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:50.356971 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ab8ed73c-adf2-4a82-87db-58e0495c8302 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:50.358013 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ab8ed73c-adf2-4a82-87db-58e0495c8302 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:50.358575 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ab8ed73c-adf2-4a82-87db-58e0495c8302 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:50.359204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ab8ed73c-adf2-4a82-87db-58e0495c8302 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:50.736372 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-402f9997-0412-4b76-9eaf-e388bf1d8865 req-f5f8f637-c918-440f-a883-05d5f03fac63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c5331a8-de67-49e9-a0f6-96c8a1915492", "name": "network-vif-unplugged", "status": "completed", "tag": "760b99b4-defc-4bbb-86a7-39ce573ef1d4"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:33:50.746444 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-402f9997-0412-4b76-9eaf-e388bf1d8865 req-f5f8f637-c918-440f-a883-05d5f03fac63 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:50.746928 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-402f9997-0412-4b76-9eaf-e388bf1d8865 req-f5f8f637-c918-440f-a883-05d5f03fac63 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:50.747356 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-402f9997-0412-4b76-9eaf-e388bf1d8865 req-f5f8f637-c918-440f-a883-05d5f03fac63 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:50.761144 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-402f9997-0412-4b76-9eaf-e388bf1d8865 req-f5f8f637-c918-440f-a883-05d5f03fac63 service nova] Creating event network-vif-unplugged:760b99b4-defc-4bbb-86a7-39ce573ef1d4 for instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 on hv-cinder-85061 Sep 19 12:33:50.766686 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-402f9997-0412-4b76-9eaf-e388bf1d8865 req-f5f8f637-c918-440f-a883-05d5f03fac63 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033909 Sep 19 12:33:50.767530 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 359/721] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:33:51.335907 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a95eb0df-76bd-4090-a9ae-3010586fa772 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:51.336951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a95eb0df-76bd-4090-a9ae-3010586fa772 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:51.343601 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a95eb0df-76bd-4090-a9ae-3010586fa772 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:51.343796 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a95eb0df-76bd-4090-a9ae-3010586fa772 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:51.344216 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a95eb0df-76bd-4090-a9ae-3010586fa772 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:51.345292 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a95eb0df-76bd-4090-a9ae-3010586fa772 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:51.345751 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a95eb0df-76bd-4090-a9ae-3010586fa772 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:51.346178 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a95eb0df-76bd-4090-a9ae-3010586fa772 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:51.468799 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-a95eb0df-76bd-4090-a9ae-3010586fa772 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:51.478463 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a95eb0df-76bd-4090-a9ae-3010586fa772 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1284 microversion: 2.1 time: 0.147144 Sep 19 12:33:51.479097 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 360/722] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:51 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:51.645892 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ab8ed73c-adf2-4a82-87db-58e0495c8302 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "POST /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.311334 Sep 19 12:33:51.647826 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 363/723] 10.222.0.93 () {62 vars in 1364 bytes} [Mon Sep 19 12:33:50 2022] POST /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/os-volume_attachments => generated 188 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:33:51.788684 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-4ab12a5a-83f9-4041-8cdc-997be6fb9450 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:33:51.789214 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-4ab12a5a-83f9-4041-8cdc-997be6fb9450 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:51.795884 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4ab12a5a-83f9-4041-8cdc-997be6fb9450 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:51.796370 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4ab12a5a-83f9-4041-8cdc-997be6fb9450 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:51.796835 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4ab12a5a-83f9-4041-8cdc-997be6fb9450 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:51.797534 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4ab12a5a-83f9-4041-8cdc-997be6fb9450 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:51.797975 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4ab12a5a-83f9-4041-8cdc-997be6fb9450 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:51.798392 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4ab12a5a-83f9-4041-8cdc-997be6fb9450 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:51.852251 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-4ab12a5a-83f9-4041-8cdc-997be6fb9450 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121428) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 12:33:52.191497 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-4ab12a5a-83f9-4041-8cdc-997be6fb9450 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "POST /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/action" status: 202 len: 0 microversion: 2.20 time: 0.406524 Sep 19 12:33:52.192828 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 361/724] 10.222.0.93 () {62 vars in 1319 bytes} [Mon Sep 19 12:33:51 2022] POST /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:33:52.203538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-42e100ff-c624-4d19-9836-4eb16c1d221c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:52.204229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-42e100ff-c624-4d19-9836-4eb16c1d221c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:52.213745 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-42e100ff-c624-4d19-9836-4eb16c1d221c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:52.214245 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-42e100ff-c624-4d19-9836-4eb16c1d221c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:52.214690 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-42e100ff-c624-4d19-9836-4eb16c1d221c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:52.215436 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-42e100ff-c624-4d19-9836-4eb16c1d221c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:52.215904 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-42e100ff-c624-4d19-9836-4eb16c1d221c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:52.216335 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-42e100ff-c624-4d19-9836-4eb16c1d221c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:52.508380 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-5a7b98b4-e43c-4d42-a081-ec79aec02904 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:52.509085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-5a7b98b4-e43c-4d42-a081-ec79aec02904 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:52.526383 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5a7b98b4-e43c-4d42-a081-ec79aec02904 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:52.527002 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5a7b98b4-e43c-4d42-a081-ec79aec02904 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:52.527546 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5a7b98b4-e43c-4d42-a081-ec79aec02904 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:52.528396 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5a7b98b4-e43c-4d42-a081-ec79aec02904 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:52.529108 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5a7b98b4-e43c-4d42-a081-ec79aec02904 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:52.529783 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5a7b98b4-e43c-4d42-a081-ec79aec02904 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:52.583100 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-42e100ff-c624-4d19-9836-4eb16c1d221c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:52.593754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-42e100ff-c624-4d19-9836-4eb16c1d221c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:52.596251 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-42e100ff-c624-4d19-9836-4eb16c1d221c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:52.597943 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-42e100ff-c624-4d19-9836-4eb16c1d221c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1752 microversion: 2.20 time: 0.399051 Sep 19 12:33:52.598505 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 364/725] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:52 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1752 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:52.631290 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5a7b98b4-e43c-4d42-a081-ec79aec02904 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:52.641681 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-5a7b98b4-e43c-4d42-a081-ec79aec02904 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1272 microversion: 2.1 time: 0.137362 Sep 19 12:33:52.642267 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 362/726] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:52 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1272 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:53.649130 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c2f93bb6-8c3e-45ef-aa5c-6e455cfccf89 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:53.651423 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c2f93bb6-8c3e-45ef-aa5c-6e455cfccf89 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:53.658114 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c2f93bb6-8c3e-45ef-aa5c-6e455cfccf89 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:53.660959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c2f93bb6-8c3e-45ef-aa5c-6e455cfccf89 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:53.660959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c2f93bb6-8c3e-45ef-aa5c-6e455cfccf89 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:53.662050 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c2f93bb6-8c3e-45ef-aa5c-6e455cfccf89 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:53.662612 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c2f93bb6-8c3e-45ef-aa5c-6e455cfccf89 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:53.663760 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c2f93bb6-8c3e-45ef-aa5c-6e455cfccf89 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:53.671327 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-44e2e7fa-bd98-4fea-a7ce-1b3144b56519 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:53.672652 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-44e2e7fa-bd98-4fea-a7ce-1b3144b56519 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:53.680797 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-44e2e7fa-bd98-4fea-a7ce-1b3144b56519 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:53.681576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-44e2e7fa-bd98-4fea-a7ce-1b3144b56519 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:53.682243 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-44e2e7fa-bd98-4fea-a7ce-1b3144b56519 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:53.682929 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-44e2e7fa-bd98-4fea-a7ce-1b3144b56519 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:53.683383 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-44e2e7fa-bd98-4fea-a7ce-1b3144b56519 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:53.683801 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-44e2e7fa-bd98-4fea-a7ce-1b3144b56519 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:53.936081 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c2f93bb6-8c3e-45ef-aa5c-6e455cfccf89 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:53.945199 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c2f93bb6-8c3e-45ef-aa5c-6e455cfccf89 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:53.951798 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c2f93bb6-8c3e-45ef-aa5c-6e455cfccf89 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:53.951798 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c2f93bb6-8c3e-45ef-aa5c-6e455cfccf89 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1752 microversion: 2.20 time: 0.303308 Sep 19 12:33:53.951798 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 365/727] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:53 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1752 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:53.952266 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-44e2e7fa-bd98-4fea-a7ce-1b3144b56519 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:53.958953 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-44e2e7fa-bd98-4fea-a7ce-1b3144b56519 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1314 microversion: 2.1 time: 0.295271 Sep 19 12:33:53.959523 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 363/728] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:53 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:33:54.040007 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-cc4e8c57-ea0a-4ff5-960a-4c8b56d275d3 req-d289d2fd-25ad-480c-9e67-0a1277a2e346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "095a68b6-5694-483a-aa92-ddfb5f061e20", "tag": "e94fa5f7-4a07-486c-a04d-ec2a380132ab"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:33:54.057419 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-cc4e8c57-ea0a-4ff5-960a-4c8b56d275d3 req-d289d2fd-25ad-480c-9e67-0a1277a2e346 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:54.058033 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-cc4e8c57-ea0a-4ff5-960a-4c8b56d275d3 req-d289d2fd-25ad-480c-9e67-0a1277a2e346 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:54.059270 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-cc4e8c57-ea0a-4ff5-960a-4c8b56d275d3 req-d289d2fd-25ad-480c-9e67-0a1277a2e346 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:54.079414 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-cc4e8c57-ea0a-4ff5-960a-4c8b56d275d3 req-d289d2fd-25ad-480c-9e67-0a1277a2e346 service nova] Creating event network-changed:e94fa5f7-4a07-486c-a04d-ec2a380132ab for instance 095a68b6-5694-483a-aa92-ddfb5f061e20 on hv-cinder-85061 Sep 19 12:33:54.089322 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-cc4e8c57-ea0a-4ff5-960a-4c8b56d275d3 req-d289d2fd-25ad-480c-9e67-0a1277a2e346 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053266 Sep 19 12:33:54.090681 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 366/729] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:33:54.974874 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-2f461597-a7e2-4ab1-802c-4ad8d8d5e9fe tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:54.975600 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-2f461597-a7e2-4ab1-802c-4ad8d8d5e9fe tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:54.982504 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f461597-a7e2-4ab1-802c-4ad8d8d5e9fe tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:54.982997 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f461597-a7e2-4ab1-802c-4ad8d8d5e9fe tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:54.983489 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f461597-a7e2-4ab1-802c-4ad8d8d5e9fe tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:54.984176 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f461597-a7e2-4ab1-802c-4ad8d8d5e9fe tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:54.984639 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f461597-a7e2-4ab1-802c-4ad8d8d5e9fe tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:54.985057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f461597-a7e2-4ab1-802c-4ad8d8d5e9fe tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:54.987738 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-d83c3fff-4a61-4f66-8c3b-6697718bf04c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:54.988467 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-d83c3fff-4a61-4f66-8c3b-6697718bf04c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:54.995106 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d83c3fff-4a61-4f66-8c3b-6697718bf04c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:54.995584 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d83c3fff-4a61-4f66-8c3b-6697718bf04c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:54.996012 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d83c3fff-4a61-4f66-8c3b-6697718bf04c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:54.996751 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d83c3fff-4a61-4f66-8c3b-6697718bf04c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:55.000421 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d83c3fff-4a61-4f66-8c3b-6697718bf04c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:55.000903 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d83c3fff-4a61-4f66-8c3b-6697718bf04c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:55.023021 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:55.184177 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2f461597-a7e2-4ab1-802c-4ad8d8d5e9fe tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:55.192945 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2f461597-a7e2-4ab1-802c-4ad8d8d5e9fe tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:55.194394 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2f461597-a7e2-4ab1-802c-4ad8d8d5e9fe tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:55.195603 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-2f461597-a7e2-4ab1-802c-4ad8d8d5e9fe tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1754 microversion: 2.20 time: 0.224799 Sep 19 12:33:55.197064 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 364/730] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:54 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1754 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:55.198568 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-d83c3fff-4a61-4f66-8c3b-6697718bf04c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:55.206456 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-d83c3fff-4a61-4f66-8c3b-6697718bf04c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1314 microversion: 2.1 time: 0.222885 Sep 19 12:33:55.207103 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 367/731] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:54 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:33:56.223363 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-21a936f0-eb02-4475-a50b-e70eba0cd972 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:56.224628 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-21a936f0-eb02-4475-a50b-e70eba0cd972 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:56.230629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-fa8198bb-c4af-4c10-b78d-a9cbba681f7a tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:56.231285 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-fa8198bb-c4af-4c10-b78d-a9cbba681f7a tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:56.244829 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fa8198bb-c4af-4c10-b78d-a9cbba681f7a tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:56.246514 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-21a936f0-eb02-4475-a50b-e70eba0cd972 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:56.247098 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-21a936f0-eb02-4475-a50b-e70eba0cd972 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:56.247570 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-21a936f0-eb02-4475-a50b-e70eba0cd972 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:56.248213 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fa8198bb-c4af-4c10-b78d-a9cbba681f7a tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:56.249059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-21a936f0-eb02-4475-a50b-e70eba0cd972 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:56.249546 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fa8198bb-c4af-4c10-b78d-a9cbba681f7a tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:56.250279 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fa8198bb-c4af-4c10-b78d-a9cbba681f7a tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:56.250714 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fa8198bb-c4af-4c10-b78d-a9cbba681f7a tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:56.251133 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fa8198bb-c4af-4c10-b78d-a9cbba681f7a tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:56.255900 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-21a936f0-eb02-4475-a50b-e70eba0cd972 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:56.256354 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-21a936f0-eb02-4475-a50b-e70eba0cd972 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:56.472762 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-fa8198bb-c4af-4c10-b78d-a9cbba681f7a tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:56.476154 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-21a936f0-eb02-4475-a50b-e70eba0cd972 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:56.481977 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-fa8198bb-c4af-4c10-b78d-a9cbba681f7a tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1314 microversion: 2.1 time: 0.255750 Sep 19 12:33:56.482795 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 368/732] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:56 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:56.487853 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-21a936f0-eb02-4475-a50b-e70eba0cd972 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:56.489339 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-21a936f0-eb02-4475-a50b-e70eba0cd972 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:56.490515 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-21a936f0-eb02-4475-a50b-e70eba0cd972 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1754 microversion: 2.20 time: 0.271457 Sep 19 12:33:56.491139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 365/733] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:56 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1754 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:33:57.515889 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ee30a400-566b-4a6c-b3e9-dafbb6d7a0fe tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:57.516484 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ee30a400-566b-4a6c-b3e9-dafbb6d7a0fe tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:57.519539 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f311e790-c0b6-4c1a-b662-9854c771307b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:57.520149 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f311e790-c0b6-4c1a-b662-9854c771307b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:57.523132 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ee30a400-566b-4a6c-b3e9-dafbb6d7a0fe tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:57.523858 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ee30a400-566b-4a6c-b3e9-dafbb6d7a0fe tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:57.524297 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ee30a400-566b-4a6c-b3e9-dafbb6d7a0fe tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:57.525030 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ee30a400-566b-4a6c-b3e9-dafbb6d7a0fe tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:57.525612 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ee30a400-566b-4a6c-b3e9-dafbb6d7a0fe tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:57.526046 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ee30a400-566b-4a6c-b3e9-dafbb6d7a0fe tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:57.526680 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f311e790-c0b6-4c1a-b662-9854c771307b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:57.527170 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f311e790-c0b6-4c1a-b662-9854c771307b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:57.527600 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f311e790-c0b6-4c1a-b662-9854c771307b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:57.528343 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f311e790-c0b6-4c1a-b662-9854c771307b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:57.529973 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f311e790-c0b6-4c1a-b662-9854c771307b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:57.529973 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f311e790-c0b6-4c1a-b662-9854c771307b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:57.534742 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:57.750975 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ee30a400-566b-4a6c-b3e9-dafbb6d7a0fe tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:57.758043 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f311e790-c0b6-4c1a-b662-9854c771307b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:57.766782 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=2 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:57.767622 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ee30a400-566b-4a6c-b3e9-dafbb6d7a0fe tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1314 microversion: 2.1 time: 0.255371 Sep 19 12:33:57.768215 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 369/734] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:57 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:57.770842 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f311e790-c0b6-4c1a-b662-9854c771307b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:57.772316 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f311e790-c0b6-4c1a-b662-9854c771307b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:57.773645 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f311e790-c0b6-4c1a-b662-9854c771307b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1810 microversion: 2.20 time: 0.258336 Sep 19 12:33:57.775858 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 366/735] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:57 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1810 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:33:58.793100 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-0cf5879f-bedc-42c7-b263-27369e178289 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:58.793742 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-0cf5879f-bedc-42c7-b263-27369e178289 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:58.802116 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-da1c36f9-b39a-439b-af96-1aec6d4cf0be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:58.802868 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-da1c36f9-b39a-439b-af96-1aec6d4cf0be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:58.806975 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0cf5879f-bedc-42c7-b263-27369e178289 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:58.807575 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0cf5879f-bedc-42c7-b263-27369e178289 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:58.808220 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0cf5879f-bedc-42c7-b263-27369e178289 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:58.809076 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0cf5879f-bedc-42c7-b263-27369e178289 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:58.809599 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0cf5879f-bedc-42c7-b263-27369e178289 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:58.810205 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0cf5879f-bedc-42c7-b263-27369e178289 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:58.821409 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=6 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:58.824916 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-da1c36f9-b39a-439b-af96-1aec6d4cf0be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:58.825475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-da1c36f9-b39a-439b-af96-1aec6d4cf0be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:58.833665 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-da1c36f9-b39a-439b-af96-1aec6d4cf0be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:58.834565 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-da1c36f9-b39a-439b-af96-1aec6d4cf0be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:58.835173 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-da1c36f9-b39a-439b-af96-1aec6d4cf0be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:58.835682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-da1c36f9-b39a-439b-af96-1aec6d4cf0be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:59.085419 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-da1c36f9-b39a-439b-af96-1aec6d4cf0be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:59.094595 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-0cf5879f-bedc-42c7-b263-27369e178289 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:59.108472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-0cf5879f-bedc-42c7-b263-27369e178289 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1314 microversion: 2.1 time: 0.319646 Sep 19 12:33:59.113531 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-da1c36f9-b39a-439b-af96-1aec6d4cf0be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:59.120435 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 370/736] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:58 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:59.121199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-da1c36f9-b39a-439b-af96-1aec6d4cf0be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:59.123763 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-da1c36f9-b39a-439b-af96-1aec6d4cf0be tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1810 microversion: 2.20 time: 0.325328 Sep 19 12:33:59.124922 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 367/737] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:33:58 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1810 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:33:59.132788 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-61d19233-eb18-4bd1-a44a-f4f63e7ac838 req-a8f0dfed-8503-49d2-b357-4effa86eef9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "095a68b6-5694-483a-aa92-ddfb5f061e20", "name": "network-vif-plugged", "status": "completed", "tag": "e94fa5f7-4a07-486c-a04d-ec2a380132ab"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:33:59.144666 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-61d19233-eb18-4bd1-a44a-f4f63e7ac838 req-a8f0dfed-8503-49d2-b357-4effa86eef9b service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:59.145751 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-61d19233-eb18-4bd1-a44a-f4f63e7ac838 req-a8f0dfed-8503-49d2-b357-4effa86eef9b service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:59.153504 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-61d19233-eb18-4bd1-a44a-f4f63e7ac838 req-a8f0dfed-8503-49d2-b357-4effa86eef9b service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:59.168391 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=4 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:59.171769 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-61d19233-eb18-4bd1-a44a-f4f63e7ac838 req-a8f0dfed-8503-49d2-b357-4effa86eef9b service nova] Creating event network-vif-plugged:e94fa5f7-4a07-486c-a04d-ec2a380132ab for instance 095a68b6-5694-483a-aa92-ddfb5f061e20 on hv-cinder-85061 Sep 19 12:33:59.178457 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-61d19233-eb18-4bd1-a44a-f4f63e7ac838 req-a8f0dfed-8503-49d2-b357-4effa86eef9b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050009 Sep 19 12:33:59.179081 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 371/738] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:34:00.135631 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-72cd10f6-81c3-4681-af31-d241adec34e6 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:00.136412 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-72cd10f6-81c3-4681-af31-d241adec34e6 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:00.144077 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-72cd10f6-81c3-4681-af31-d241adec34e6 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:00.144559 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-72cd10f6-81c3-4681-af31-d241adec34e6 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:00.145640 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-72cd10f6-81c3-4681-af31-d241adec34e6 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:00.146382 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-72cd10f6-81c3-4681-af31-d241adec34e6 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:00.146842 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-72cd10f6-81c3-4681-af31-d241adec34e6 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:00.147265 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-72cd10f6-81c3-4681-af31-d241adec34e6 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:00.164443 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-fbb5e012-4f69-4c15-9274-9a4b1d7a24d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:00.166389 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-fbb5e012-4f69-4c15-9274-9a4b1d7a24d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:00.174896 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fbb5e012-4f69-4c15-9274-9a4b1d7a24d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:00.175800 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fbb5e012-4f69-4c15-9274-9a4b1d7a24d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:00.181053 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fbb5e012-4f69-4c15-9274-9a4b1d7a24d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:00.182834 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fbb5e012-4f69-4c15-9274-9a4b1d7a24d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:00.183555 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fbb5e012-4f69-4c15-9274-9a4b1d7a24d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:00.184219 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fbb5e012-4f69-4c15-9274-9a4b1d7a24d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:00.477249 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-72cd10f6-81c3-4681-af31-d241adec34e6 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:00.486427 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-72cd10f6-81c3-4681-af31-d241adec34e6 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1314 microversion: 2.1 time: 0.355297 Sep 19 12:34:00.492778 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 368/739] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:00 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:34:00.499536 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-fbb5e012-4f69-4c15-9274-9a4b1d7a24d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:00.512165 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-fbb5e012-4f69-4c15-9274-9a4b1d7a24d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:00.514042 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-fbb5e012-4f69-4c15-9274-9a4b1d7a24d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:00.515682 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-fbb5e012-4f69-4c15-9274-9a4b1d7a24d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1810 microversion: 2.20 time: 0.358947 Sep 19 12:34:00.516343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 372/740] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:34:00 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1810 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:34:01.512664 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f74ed2a1-92eb-489d-ad2f-175ad2ff625c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:01.514056 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f74ed2a1-92eb-489d-ad2f-175ad2ff625c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:01.521911 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f74ed2a1-92eb-489d-ad2f-175ad2ff625c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:01.522718 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f74ed2a1-92eb-489d-ad2f-175ad2ff625c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:01.523375 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f74ed2a1-92eb-489d-ad2f-175ad2ff625c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:01.524362 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f74ed2a1-92eb-489d-ad2f-175ad2ff625c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:01.525131 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f74ed2a1-92eb-489d-ad2f-175ad2ff625c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:01.525737 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f74ed2a1-92eb-489d-ad2f-175ad2ff625c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:01.545933 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-0f0949bf-f484-4335-9258-ced148a90645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:01.552509 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-0f0949bf-f484-4335-9258-ced148a90645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:01.560668 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0f0949bf-f484-4335-9258-ced148a90645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:01.568018 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0f0949bf-f484-4335-9258-ced148a90645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:01.568018 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0f0949bf-f484-4335-9258-ced148a90645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:01.568018 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0f0949bf-f484-4335-9258-ced148a90645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:01.568018 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0f0949bf-f484-4335-9258-ced148a90645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:01.568765 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0f0949bf-f484-4335-9258-ced148a90645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:01.833765 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-0f0949bf-f484-4335-9258-ced148a90645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:01.870108 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-0f0949bf-f484-4335-9258-ced148a90645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:01.876861 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-0f0949bf-f484-4335-9258-ced148a90645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:01.878161 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-0f0949bf-f484-4335-9258-ced148a90645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1810 microversion: 2.20 time: 0.337427 Sep 19 12:34:01.885687 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 373/741] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:34:01 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1810 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:34:01.894567 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f74ed2a1-92eb-489d-ad2f-175ad2ff625c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:01.903482 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f74ed2a1-92eb-489d-ad2f-175ad2ff625c tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1314 microversion: 2.1 time: 0.394817 Sep 19 12:34:01.916835 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 369/742] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:01 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:34:02.925001 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-71538a25-c505-4029-8eef-5f61aabd8645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:02.926279 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-71538a25-c505-4029-8eef-5f61aabd8645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:02.932341 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-2aa865d2-f379-4f5b-8c8d-c228770e045b tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:02.933117 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-2aa865d2-f379-4f5b-8c8d-c228770e045b tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:02.939030 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-71538a25-c505-4029-8eef-5f61aabd8645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:02.939822 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-71538a25-c505-4029-8eef-5f61aabd8645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:02.940266 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-71538a25-c505-4029-8eef-5f61aabd8645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:02.941037 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-71538a25-c505-4029-8eef-5f61aabd8645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:02.941502 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-71538a25-c505-4029-8eef-5f61aabd8645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:02.941935 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-71538a25-c505-4029-8eef-5f61aabd8645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:02.946309 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2aa865d2-f379-4f5b-8c8d-c228770e045b tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:02.947347 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2aa865d2-f379-4f5b-8c8d-c228770e045b tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:02.948494 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2aa865d2-f379-4f5b-8c8d-c228770e045b tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:02.949965 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2aa865d2-f379-4f5b-8c8d-c228770e045b tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:02.950436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2aa865d2-f379-4f5b-8c8d-c228770e045b tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:02.951628 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2aa865d2-f379-4f5b-8c8d-c228770e045b tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:03.177787 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2aa865d2-f379-4f5b-8c8d-c228770e045b tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:03.180101 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-71538a25-c505-4029-8eef-5f61aabd8645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:03.189886 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-71538a25-c505-4029-8eef-5f61aabd8645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:03.191403 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-71538a25-c505-4029-8eef-5f61aabd8645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:03.192654 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-71538a25-c505-4029-8eef-5f61aabd8645 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1810 microversion: 2.20 time: 0.272178 Sep 19 12:34:03.193327 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 374/743] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:34:02 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1810 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:34:03.228470 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-2aa865d2-f379-4f5b-8c8d-c228770e045b tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1314 microversion: 2.1 time: 0.301493 Sep 19 12:34:03.242124 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 370/744] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:02 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:04.240405 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-bfe5939d-2943-4940-b39d-8c1f26626e9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:04.242543 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-bfe5939d-2943-4940-b39d-8c1f26626e9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:04.253759 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bfe5939d-2943-4940-b39d-8c1f26626e9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:04.254952 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bfe5939d-2943-4940-b39d-8c1f26626e9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:04.255873 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bfe5939d-2943-4940-b39d-8c1f26626e9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:04.257641 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bfe5939d-2943-4940-b39d-8c1f26626e9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:04.261365 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-dda5c333-a70b-4e32-b72c-110a208ac473 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:04.265342 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-dda5c333-a70b-4e32-b72c-110a208ac473 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:04.267459 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bfe5939d-2943-4940-b39d-8c1f26626e9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:04.267459 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bfe5939d-2943-4940-b39d-8c1f26626e9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:04.279667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dda5c333-a70b-4e32-b72c-110a208ac473 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:04.281215 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dda5c333-a70b-4e32-b72c-110a208ac473 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:04.282279 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dda5c333-a70b-4e32-b72c-110a208ac473 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:04.283855 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dda5c333-a70b-4e32-b72c-110a208ac473 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:04.285231 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dda5c333-a70b-4e32-b72c-110a208ac473 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:04.286449 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dda5c333-a70b-4e32-b72c-110a208ac473 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:04.617040 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-dda5c333-a70b-4e32-b72c-110a208ac473 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:04.638681 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-dda5c333-a70b-4e32-b72c-110a208ac473 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1314 microversion: 2.1 time: 0.384797 Sep 19 12:34:04.641860 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 371/745] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:04 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:04.665312 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-bfe5939d-2943-4940-b39d-8c1f26626e9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:04.684585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-bfe5939d-2943-4940-b39d-8c1f26626e9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:04.687485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-bfe5939d-2943-4940-b39d-8c1f26626e9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:04.691234 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-bfe5939d-2943-4940-b39d-8c1f26626e9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1810 microversion: 2.20 time: 0.457129 Sep 19 12:34:04.692979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 375/746] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:34:04 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1810 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:34:05.680344 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8621c007-c3d0-4c2d-a605-7ca364db93e2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:05.682378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-8621c007-c3d0-4c2d-a605-7ca364db93e2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:05.693810 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8621c007-c3d0-4c2d-a605-7ca364db93e2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:05.694638 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8621c007-c3d0-4c2d-a605-7ca364db93e2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:05.695694 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8621c007-c3d0-4c2d-a605-7ca364db93e2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:05.697492 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8621c007-c3d0-4c2d-a605-7ca364db93e2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:05.697976 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8621c007-c3d0-4c2d-a605-7ca364db93e2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:05.698416 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8621c007-c3d0-4c2d-a605-7ca364db93e2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:05.736034 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-95730069-4155-4624-8941-00b0698b6efc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:05.736815 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-95730069-4155-4624-8941-00b0698b6efc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:05.748646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-95730069-4155-4624-8941-00b0698b6efc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:05.749755 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-95730069-4155-4624-8941-00b0698b6efc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:05.749755 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-95730069-4155-4624-8941-00b0698b6efc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:05.750240 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-95730069-4155-4624-8941-00b0698b6efc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:05.750743 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-95730069-4155-4624-8941-00b0698b6efc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:05.751186 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-95730069-4155-4624-8941-00b0698b6efc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:05.955305 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-8621c007-c3d0-4c2d-a605-7ca364db93e2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:05.967095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8621c007-c3d0-4c2d-a605-7ca364db93e2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1314 microversion: 2.1 time: 0.293095 Sep 19 12:34:05.968650 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 372/747] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:05 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:06.003358 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-95730069-4155-4624-8941-00b0698b6efc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:06.013731 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-95730069-4155-4624-8941-00b0698b6efc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:06.015238 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-95730069-4155-4624-8941-00b0698b6efc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:06.016459 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-95730069-4155-4624-8941-00b0698b6efc tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1810 microversion: 2.20 time: 0.284742 Sep 19 12:34:06.017067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 376/748] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:34:05 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1810 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:34:06.995669 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-cdd27216-e38a-41c8-b3a8-110410b12f60 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:06.996668 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-cdd27216-e38a-41c8-b3a8-110410b12f60 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:07.004977 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cdd27216-e38a-41c8-b3a8-110410b12f60 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:07.005476 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cdd27216-e38a-41c8-b3a8-110410b12f60 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:07.005917 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cdd27216-e38a-41c8-b3a8-110410b12f60 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:07.006707 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cdd27216-e38a-41c8-b3a8-110410b12f60 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:07.007441 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cdd27216-e38a-41c8-b3a8-110410b12f60 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:07.007879 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cdd27216-e38a-41c8-b3a8-110410b12f60 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:07.046084 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-58541458-cfdb-43ff-9c74-b1a03f51b577 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:07.047028 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-58541458-cfdb-43ff-9c74-b1a03f51b577 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:07.057014 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-58541458-cfdb-43ff-9c74-b1a03f51b577 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:07.057333 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-58541458-cfdb-43ff-9c74-b1a03f51b577 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:07.057889 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-58541458-cfdb-43ff-9c74-b1a03f51b577 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:07.058631 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-58541458-cfdb-43ff-9c74-b1a03f51b577 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:07.059051 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-58541458-cfdb-43ff-9c74-b1a03f51b577 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:07.060421 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-58541458-cfdb-43ff-9c74-b1a03f51b577 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:07.220901 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-cdd27216-e38a-41c8-b3a8-110410b12f60 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:07.233052 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-cdd27216-e38a-41c8-b3a8-110410b12f60 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1314 microversion: 2.1 time: 0.241942 Sep 19 12:34:07.233851 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 373/749] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:06 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:07.297136 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-58541458-cfdb-43ff-9c74-b1a03f51b577 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:07.307258 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-58541458-cfdb-43ff-9c74-b1a03f51b577 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:07.308863 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-58541458-cfdb-43ff-9c74-b1a03f51b577 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:07.310105 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-58541458-cfdb-43ff-9c74-b1a03f51b577 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1810 microversion: 2.20 time: 0.270448 Sep 19 12:34:07.313066 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 377/750] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:34:07 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1810 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:34:08.258054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-cb6611bd-7fc5-43b2-a99f-a473988ea791 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:08.258845 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-cb6611bd-7fc5-43b2-a99f-a473988ea791 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:08.266356 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cb6611bd-7fc5-43b2-a99f-a473988ea791 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:08.266846 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cb6611bd-7fc5-43b2-a99f-a473988ea791 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:08.267371 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cb6611bd-7fc5-43b2-a99f-a473988ea791 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:08.268282 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cb6611bd-7fc5-43b2-a99f-a473988ea791 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:08.268769 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cb6611bd-7fc5-43b2-a99f-a473988ea791 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:08.269191 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cb6611bd-7fc5-43b2-a99f-a473988ea791 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:08.342845 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ea197025-4ee1-45e4-b716-76a6fea70747 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:08.343609 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ea197025-4ee1-45e4-b716-76a6fea70747 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:08.354138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ea197025-4ee1-45e4-b716-76a6fea70747 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:08.356140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ea197025-4ee1-45e4-b716-76a6fea70747 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:08.356764 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ea197025-4ee1-45e4-b716-76a6fea70747 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:08.361228 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ea197025-4ee1-45e4-b716-76a6fea70747 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:08.361228 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ea197025-4ee1-45e4-b716-76a6fea70747 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:08.361228 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ea197025-4ee1-45e4-b716-76a6fea70747 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:08.501046 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-cb6611bd-7fc5-43b2-a99f-a473988ea791 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:08.505500 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-cb6611bd-7fc5-43b2-a99f-a473988ea791 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1314 microversion: 2.1 time: 0.251581 Sep 19 12:34:08.506099 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 374/751] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:08 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:34:08.569589 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ea197025-4ee1-45e4-b716-76a6fea70747 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:08.579669 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ea197025-4ee1-45e4-b716-76a6fea70747 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:08.581177 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ea197025-4ee1-45e4-b716-76a6fea70747 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:08.582382 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ea197025-4ee1-45e4-b716-76a6fea70747 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1810 microversion: 2.20 time: 0.245860 Sep 19 12:34:08.582954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 378/752] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:34:08 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1810 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:34:09.536403 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c2b4df5e-61dc-46c0-82ce-d8d128ecd6ff tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:09.536403 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c2b4df5e-61dc-46c0-82ce-d8d128ecd6ff tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:09.541116 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c2b4df5e-61dc-46c0-82ce-d8d128ecd6ff tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:09.541609 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c2b4df5e-61dc-46c0-82ce-d8d128ecd6ff tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:09.542046 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c2b4df5e-61dc-46c0-82ce-d8d128ecd6ff tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:09.542759 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c2b4df5e-61dc-46c0-82ce-d8d128ecd6ff tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:09.543212 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c2b4df5e-61dc-46c0-82ce-d8d128ecd6ff tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:09.543679 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c2b4df5e-61dc-46c0-82ce-d8d128ecd6ff tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:09.611707 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-39ebaee9-9a50-427b-8585-ee37a9ab7a34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:09.612479 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-39ebaee9-9a50-427b-8585-ee37a9ab7a34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:09.620172 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-39ebaee9-9a50-427b-8585-ee37a9ab7a34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:09.621025 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-39ebaee9-9a50-427b-8585-ee37a9ab7a34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:09.621560 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-39ebaee9-9a50-427b-8585-ee37a9ab7a34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:09.622544 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-39ebaee9-9a50-427b-8585-ee37a9ab7a34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:09.623104 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-39ebaee9-9a50-427b-8585-ee37a9ab7a34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:09.623857 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-39ebaee9-9a50-427b-8585-ee37a9ab7a34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:09.753364 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c2b4df5e-61dc-46c0-82ce-d8d128ecd6ff tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:09.765761 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c2b4df5e-61dc-46c0-82ce-d8d128ecd6ff tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1464 microversion: 2.1 time: 0.238467 Sep 19 12:34:09.766617 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 375/753] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:09 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1464 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:09.822475 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-39ebaee9-9a50-427b-8585-ee37a9ab7a34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:09.835582 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-39ebaee9-9a50-427b-8585-ee37a9ab7a34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:09.838511 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-80ada3c6-8dd0-456d-8a3c-4495650d0751 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:09.839321 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-80ada3c6-8dd0-456d-8a3c-4495650d0751 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:09.839744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-39ebaee9-9a50-427b-8585-ee37a9ab7a34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:09.841795 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-39ebaee9-9a50-427b-8585-ee37a9ab7a34 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1810 microversion: 2.20 time: 0.234543 Sep 19 12:34:09.842755 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 379/754] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:34:09 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1810 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:34:09.847889 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-80ada3c6-8dd0-456d-8a3c-4495650d0751 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:09.850233 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-80ada3c6-8dd0-456d-8a3c-4495650d0751 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:09.850233 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-80ada3c6-8dd0-456d-8a3c-4495650d0751 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:09.850233 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-80ada3c6-8dd0-456d-8a3c-4495650d0751 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:09.850233 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-80ada3c6-8dd0-456d-8a3c-4495650d0751 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:09.850833 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-80ada3c6-8dd0-456d-8a3c-4495650d0751 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:09.878063 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-80ada3c6-8dd0-456d-8a3c-4495650d0751 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Going to try to terminate instance {{(pid=121428) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:34:10.186290 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-80ada3c6-8dd0-456d-8a3c-4495650d0751 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "DELETE /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 204 len: 0 microversion: 2.1 time: 0.354929 Sep 19 12:34:10.186907 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 376/755] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:34:09 2022] DELETE /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 12:34:10.195548 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-681517b7-7b51-4230-a69a-70cf23155d61 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:10.196188 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-681517b7-7b51-4230-a69a-70cf23155d61 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:10.203466 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-681517b7-7b51-4230-a69a-70cf23155d61 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:10.203961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-681517b7-7b51-4230-a69a-70cf23155d61 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:10.204400 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-681517b7-7b51-4230-a69a-70cf23155d61 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:10.205160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-681517b7-7b51-4230-a69a-70cf23155d61 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:10.205615 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-681517b7-7b51-4230-a69a-70cf23155d61 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:10.206044 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-681517b7-7b51-4230-a69a-70cf23155d61 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:10.435952 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-681517b7-7b51-4230-a69a-70cf23155d61 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:10.435952 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-681517b7-7b51-4230-a69a-70cf23155d61 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1470 microversion: 2.1 time: 0.184246 Sep 19 12:34:10.435952 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 380/756] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:10 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1470 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:10.879078 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-2eefb40b-57d9-4cc2-afd5-c7f977d4860d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:10.879774 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-2eefb40b-57d9-4cc2-afd5-c7f977d4860d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:10.887445 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2eefb40b-57d9-4cc2-afd5-c7f977d4860d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:10.887932 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2eefb40b-57d9-4cc2-afd5-c7f977d4860d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:10.888365 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2eefb40b-57d9-4cc2-afd5-c7f977d4860d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:10.889572 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2eefb40b-57d9-4cc2-afd5-c7f977d4860d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:10.890027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2eefb40b-57d9-4cc2-afd5-c7f977d4860d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:10.890480 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2eefb40b-57d9-4cc2-afd5-c7f977d4860d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:11.037492 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2eefb40b-57d9-4cc2-afd5-c7f977d4860d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:11.047438 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2eefb40b-57d9-4cc2-afd5-c7f977d4860d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:11.048912 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2eefb40b-57d9-4cc2-afd5-c7f977d4860d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:11.050124 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-2eefb40b-57d9-4cc2-afd5-c7f977d4860d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1810 microversion: 2.20 time: 0.175386 Sep 19 12:34:11.050704 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 377/757] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:34:10 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:34:11.399688 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-35eea1bc-c0bc-485d-be1c-4f3d80085cd2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:11.400435 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-35eea1bc-c0bc-485d-be1c-4f3d80085cd2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:11.406985 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-35eea1bc-c0bc-485d-be1c-4f3d80085cd2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:11.407465 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-35eea1bc-c0bc-485d-be1c-4f3d80085cd2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:11.407893 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-35eea1bc-c0bc-485d-be1c-4f3d80085cd2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:11.408586 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-35eea1bc-c0bc-485d-be1c-4f3d80085cd2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:11.409055 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-35eea1bc-c0bc-485d-be1c-4f3d80085cd2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:11.409477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-35eea1bc-c0bc-485d-be1c-4f3d80085cd2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:11.544895 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-35eea1bc-c0bc-485d-be1c-4f3d80085cd2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:11.552955 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-35eea1bc-c0bc-485d-be1c-4f3d80085cd2 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1470 microversion: 2.1 time: 0.157162 Sep 19 12:34:11.553542 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 381/758] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:11 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:12.076028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a85eee93-6a95-4f25-ba27-6e7022eeb60b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:12.078410 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a85eee93-6a95-4f25-ba27-6e7022eeb60b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:12.083169 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a85eee93-6a95-4f25-ba27-6e7022eeb60b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:12.083859 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a85eee93-6a95-4f25-ba27-6e7022eeb60b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:12.084238 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a85eee93-6a95-4f25-ba27-6e7022eeb60b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:12.085045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a85eee93-6a95-4f25-ba27-6e7022eeb60b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:12.086382 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a85eee93-6a95-4f25-ba27-6e7022eeb60b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:12.086382 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a85eee93-6a95-4f25-ba27-6e7022eeb60b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:12.297652 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-a85eee93-6a95-4f25-ba27-6e7022eeb60b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:12.307318 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-a85eee93-6a95-4f25-ba27-6e7022eeb60b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:12.308755 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-a85eee93-6a95-4f25-ba27-6e7022eeb60b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:12.309911 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a85eee93-6a95-4f25-ba27-6e7022eeb60b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1810 microversion: 2.20 time: 0.238413 Sep 19 12:34:12.310466 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 378/759] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:34:12 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1810 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:34:12.577231 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-41092b2c-a529-4276-b8f6-929d53d43900 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:12.577860 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-41092b2c-a529-4276-b8f6-929d53d43900 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:12.585601 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-41092b2c-a529-4276-b8f6-929d53d43900 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:12.586095 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-41092b2c-a529-4276-b8f6-929d53d43900 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:12.586738 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-41092b2c-a529-4276-b8f6-929d53d43900 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:12.587674 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-41092b2c-a529-4276-b8f6-929d53d43900 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:12.588135 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-41092b2c-a529-4276-b8f6-929d53d43900 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:12.588566 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-41092b2c-a529-4276-b8f6-929d53d43900 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:12.785829 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-1275e5ad-efbc-47c1-96c7-a250532ca1e8 req-23097cad-907f-456c-8e98-ecc009a713d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "095a68b6-5694-483a-aa92-ddfb5f061e20", "name": "network-vif-deleted", "tag": "e94fa5f7-4a07-486c-a04d-ec2a380132ab"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:12.796350 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-1275e5ad-efbc-47c1-96c7-a250532ca1e8 req-23097cad-907f-456c-8e98-ecc009a713d3 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:12.796893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-1275e5ad-efbc-47c1-96c7-a250532ca1e8 req-23097cad-907f-456c-8e98-ecc009a713d3 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:12.797324 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-1275e5ad-efbc-47c1-96c7-a250532ca1e8 req-23097cad-907f-456c-8e98-ecc009a713d3 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:12.803299 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-41092b2c-a529-4276-b8f6-929d53d43900 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:12.809278 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-1275e5ad-efbc-47c1-96c7-a250532ca1e8 req-23097cad-907f-456c-8e98-ecc009a713d3 service nova] Creating event network-vif-deleted:e94fa5f7-4a07-486c-a04d-ec2a380132ab for instance 095a68b6-5694-483a-aa92-ddfb5f061e20 on hv-cinder-85061 Sep 19 12:34:12.811830 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-41092b2c-a529-4276-b8f6-929d53d43900 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1428 microversion: 2.1 time: 0.238870 Sep 19 12:34:12.812412 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 382/760] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:12 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1428 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:12.814135 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-1275e5ad-efbc-47c1-96c7-a250532ca1e8 req-23097cad-907f-456c-8e98-ecc009a713d3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031953 Sep 19 12:34:12.814805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 379/761] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:34:13.336625 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9da2e66e-5e6c-4c80-b238-16b3be9f52a0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:13.337920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9da2e66e-5e6c-4c80-b238-16b3be9f52a0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:13.343984 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9da2e66e-5e6c-4c80-b238-16b3be9f52a0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:13.344550 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9da2e66e-5e6c-4c80-b238-16b3be9f52a0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:13.345092 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9da2e66e-5e6c-4c80-b238-16b3be9f52a0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:13.345862 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9da2e66e-5e6c-4c80-b238-16b3be9f52a0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:13.346399 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9da2e66e-5e6c-4c80-b238-16b3be9f52a0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:13.346997 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9da2e66e-5e6c-4c80-b238-16b3be9f52a0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:13.498084 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9da2e66e-5e6c-4c80-b238-16b3be9f52a0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:13.507581 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9da2e66e-5e6c-4c80-b238-16b3be9f52a0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:13.509079 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9da2e66e-5e6c-4c80-b238-16b3be9f52a0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:13.510279 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9da2e66e-5e6c-4c80-b238-16b3be9f52a0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1810 microversion: 2.20 time: 0.177696 Sep 19 12:34:13.510834 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 383/762] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:34:13 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:34:13.839114 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-53898f50-d6a5-4f66-a297-bf53b409da16 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:13.839821 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-53898f50-d6a5-4f66-a297-bf53b409da16 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:13.846704 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-53898f50-d6a5-4f66-a297-bf53b409da16 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:13.847233 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-53898f50-d6a5-4f66-a297-bf53b409da16 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:13.848261 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-53898f50-d6a5-4f66-a297-bf53b409da16 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:13.849031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-53898f50-d6a5-4f66-a297-bf53b409da16 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:13.849495 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-53898f50-d6a5-4f66-a297-bf53b409da16 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:13.849925 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-53898f50-d6a5-4f66-a297-bf53b409da16 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:13.901082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-53898f50-d6a5-4f66-a297-bf53b409da16 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:13.901082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-53898f50-d6a5-4f66-a297-bf53b409da16 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:13.901082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-53898f50-d6a5-4f66-a297-bf53b409da16 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:13.901682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-53898f50-d6a5-4f66-a297-bf53b409da16 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lazy-loading 'fault' on Instance uuid 095a68b6-5694-483a-aa92-ddfb5f061e20 {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:34:13.956163 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-53898f50-d6a5-4f66-a297-bf53b409da16 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36221e0d7016479396e25381d80a26ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d13fe0d14347878b8947fcee1767ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:13.964415 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-53898f50-d6a5-4f66-a297-bf53b409da16 tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 200 len: 1304 microversion: 2.1 time: 0.132323 Sep 19 12:34:13.965038 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 380/763] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:13 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:14.539481 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2cb4c59e-8db4-4d8c-9179-92e76a86f94c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:14.540929 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2cb4c59e-8db4-4d8c-9179-92e76a86f94c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:14.547960 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2cb4c59e-8db4-4d8c-9179-92e76a86f94c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:14.548619 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2cb4c59e-8db4-4d8c-9179-92e76a86f94c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:14.548953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2cb4c59e-8db4-4d8c-9179-92e76a86f94c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:14.549681 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2cb4c59e-8db4-4d8c-9179-92e76a86f94c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:14.550138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2cb4c59e-8db4-4d8c-9179-92e76a86f94c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:14.550783 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2cb4c59e-8db4-4d8c-9179-92e76a86f94c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:14.872352 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2cb4c59e-8db4-4d8c-9179-92e76a86f94c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:14.877939 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=100 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:14.890726 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2cb4c59e-8db4-4d8c-9179-92e76a86f94c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:14.892296 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2cb4c59e-8db4-4d8c-9179-92e76a86f94c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:14.893885 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2cb4c59e-8db4-4d8c-9179-92e76a86f94c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1810 microversion: 2.20 time: 0.358505 Sep 19 12:34:14.894460 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 384/764] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:34:14 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1810 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:34:14.990537 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ada48d5b-37f6-46b0-b81e-d66c56e805bd tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:14.991385 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-ada48d5b-37f6-46b0-b81e-d66c56e805bd tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] [instance: 095a68b6-5694-483a-aa92-ddfb5f061e20] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:14.994356 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:14.999337 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ada48d5b-37f6-46b0-b81e-d66c56e805bd tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:14.999961 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ada48d5b-37f6-46b0-b81e-d66c56e805bd tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:15.000501 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ada48d5b-37f6-46b0-b81e-d66c56e805bd tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:15.001225 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ada48d5b-37f6-46b0-b81e-d66c56e805bd tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:15.001670 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ada48d5b-37f6-46b0-b81e-d66c56e805bd tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:15.002079 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ada48d5b-37f6-46b0-b81e-d66c56e805bd tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:15.016287 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-ada48d5b-37f6-46b0-b81e-d66c56e805bd tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] HTTP exception thrown: Instance 095a68b6-5694-483a-aa92-ddfb5f061e20 could not be found. Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ada48d5b-37f6-46b0-b81e-d66c56e805bd tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Request method failure captured: Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 HTTP/1.1 Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKGGobW5vaQ0DUv17SZxKB_Z19yKPke5e1PC2VqVeU7fuFvtzFKHbfT5V4_g58c9KiohXf6ECpBYTIsEMz6jl0dXLhFmEuIR1c6NuSj133hnUS8ewY-tdvZEYkStnzmq6CXzw2V6iZ96rRprKKdeucAfQ6M_TNRDcs-00aqf1sb_aBIQ Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 37d13fe0d14347878b8947fcee1767ef Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-VolumesNegativeTest-755503130 Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:34:15.017951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:34:15.019576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37d13fe0d14347878b8947fcee1767ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_37d13fe0d14347878b8947fcee1767ef", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37d13fe0d14347878b8947fcee1767ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/37d13fe0d14347878b8947fcee1767ef"}]}] Sep 19 12:34:15.019576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-VolumesNegativeTest-755503130 Sep 19 12:34:15.019576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 37d13fe0d14347878b8947fcee1767ef Sep 19 12:34:15.019576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-VolumesNegativeTest-755503130 Sep 19 12:34:15.019576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-VolumesNegativeTest-755503130-project Sep 19 12:34:15.019576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:34:15.019576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:34:15.019576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: 36221e0d7016479396e25381d80a26ed Sep 19 12:34:15.019576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-VolumesNegativeTest-755503130-project Sep 19 12:34:15.019576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:34:15.019576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance 095a68b6-5694-483a-aa92-ddfb5f061e20 could not be found. Sep 19 12:34:15.019576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': '095a68b6-5694-483a-aa92-ddfb5f061e20'} Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 095a68b6-5694-483a-aa92-ddfb5f061e20 could not be found. Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:34:15.020558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:34:15.022041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:34:15.022041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:34:15.022041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:34:15.022041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:34:15.022041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:34:15.022041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:34:15.022041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:34:15.022041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 095a68b6-5694-483a-aa92-ddfb5f061e20 could not be found. Sep 19 12:34:15.022041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:34:15.022041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:34:15.022041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:34:15.022041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:34:15.022041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:34:15.022041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:34:15.022041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:34:15.022041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:34:15.022041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 095a68b6-5694-483a-aa92-ddfb5f061e20 could not be found. Sep 19 12:34:15.022041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:34:15.023404 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ada48d5b-37f6-46b0-b81e-d66c56e805bd tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] Returning 404 to user: Instance 095a68b6-5694-483a-aa92-ddfb5f061e20 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:34:15.023404 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ada48d5b-37f6-46b0-b81e-d66c56e805bd tempest-VolumesNegativeTest-755503130 tempest-VolumesNegativeTest-755503130-project] 10.222.0.93 "GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20" status: 404 len: 111 microversion: 2.1 time: 0.033507 Sep 19 12:34:15.023404 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 381/765] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:14 2022] GET /compute/v2.1/servers/095a68b6-5694-483a-aa92-ddfb5f061e20 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:34:15.940457 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-503fb2c3-06b3-4a54-b2c8-4a2d447d5794 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:15.941206 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-503fb2c3-06b3-4a54-b2c8-4a2d447d5794 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:15.949183 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-503fb2c3-06b3-4a54-b2c8-4a2d447d5794 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:15.949662 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-503fb2c3-06b3-4a54-b2c8-4a2d447d5794 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:15.950101 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-503fb2c3-06b3-4a54-b2c8-4a2d447d5794 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:15.950854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-503fb2c3-06b3-4a54-b2c8-4a2d447d5794 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:15.951304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-503fb2c3-06b3-4a54-b2c8-4a2d447d5794 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:15.951727 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-503fb2c3-06b3-4a54-b2c8-4a2d447d5794 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:16.104130 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-503fb2c3-06b3-4a54-b2c8-4a2d447d5794 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:16.114331 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-503fb2c3-06b3-4a54-b2c8-4a2d447d5794 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:16.117031 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-503fb2c3-06b3-4a54-b2c8-4a2d447d5794 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:16.117177 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-503fb2c3-06b3-4a54-b2c8-4a2d447d5794 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1810 microversion: 2.20 time: 0.180876 Sep 19 12:34:16.117805 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 385/766] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:34:15 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:34:16.884938 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-bcd9c03d-57d8-4f9f-a43d-7173f8873945 req-276c1bca-ea80-4ea3-aad3-1af468363eef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c5331a8-de67-49e9-a0f6-96c8a1915492", "name": "network-vif-plugged", "status": "completed", "tag": "760b99b4-defc-4bbb-86a7-39ce573ef1d4"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:16.897533 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-bcd9c03d-57d8-4f9f-a43d-7173f8873945 req-276c1bca-ea80-4ea3-aad3-1af468363eef service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:16.898285 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-bcd9c03d-57d8-4f9f-a43d-7173f8873945 req-276c1bca-ea80-4ea3-aad3-1af468363eef service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:16.898948 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-bcd9c03d-57d8-4f9f-a43d-7173f8873945 req-276c1bca-ea80-4ea3-aad3-1af468363eef service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:16.910571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:16.912761 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-bcd9c03d-57d8-4f9f-a43d-7173f8873945 req-276c1bca-ea80-4ea3-aad3-1af468363eef service nova] Creating event network-vif-plugged:760b99b4-defc-4bbb-86a7-39ce573ef1d4 for instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 on hv-cinder-85061 Sep 19 12:34:16.918607 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-bcd9c03d-57d8-4f9f-a43d-7173f8873945 req-276c1bca-ea80-4ea3-aad3-1af468363eef service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037719 Sep 19 12:34:16.919028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 382/767] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:34:17.143735 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-eabc1413-fc6b-4000-bfdb-b0f855787858 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:17.144352 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-eabc1413-fc6b-4000-bfdb-b0f855787858 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:17.151592 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-eabc1413-fc6b-4000-bfdb-b0f855787858 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:17.152124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-eabc1413-fc6b-4000-bfdb-b0f855787858 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:17.152590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-eabc1413-fc6b-4000-bfdb-b0f855787858 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:17.154177 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-eabc1413-fc6b-4000-bfdb-b0f855787858 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:17.154788 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-eabc1413-fc6b-4000-bfdb-b0f855787858 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:17.155226 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-eabc1413-fc6b-4000-bfdb-b0f855787858 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:17.296915 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-eabc1413-fc6b-4000-bfdb-b0f855787858 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:17.307068 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-eabc1413-fc6b-4000-bfdb-b0f855787858 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:17.308682 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-eabc1413-fc6b-4000-bfdb-b0f855787858 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:17.310069 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-eabc1413-fc6b-4000-bfdb-b0f855787858 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1810 microversion: 2.20 time: 0.170244 Sep 19 12:34:17.310692 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 386/768] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:34:17 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:34:18.337619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-5a91f589-4d2f-4c41-98fb-967390b4e1cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:18.338306 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-5a91f589-4d2f-4c41-98fb-967390b4e1cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:18.345455 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5a91f589-4d2f-4c41-98fb-967390b4e1cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:18.345924 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5a91f589-4d2f-4c41-98fb-967390b4e1cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:18.346389 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5a91f589-4d2f-4c41-98fb-967390b4e1cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:18.347066 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5a91f589-4d2f-4c41-98fb-967390b4e1cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:18.347508 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5a91f589-4d2f-4c41-98fb-967390b4e1cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:18.362047 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5a91f589-4d2f-4c41-98fb-967390b4e1cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:18.486108 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5a91f589-4d2f-4c41-98fb-967390b4e1cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:18.495749 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5a91f589-4d2f-4c41-98fb-967390b4e1cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:18.497280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5a91f589-4d2f-4c41-98fb-967390b4e1cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:18.498530 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-5a91f589-4d2f-4c41-98fb-967390b4e1cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1810 microversion: 2.20 time: 0.166127 Sep 19 12:34:18.498973 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 383/769] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:34:18 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:34:19.526866 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9a5292b1-2d29-4170-ac2c-2e6e881650d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:19.527546 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9a5292b1-2d29-4170-ac2c-2e6e881650d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:19.530215 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=62 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:19.542215 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9a5292b1-2d29-4170-ac2c-2e6e881650d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:19.542215 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9a5292b1-2d29-4170-ac2c-2e6e881650d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:19.542215 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9a5292b1-2d29-4170-ac2c-2e6e881650d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:19.542215 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9a5292b1-2d29-4170-ac2c-2e6e881650d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:19.542973 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9a5292b1-2d29-4170-ac2c-2e6e881650d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:19.542973 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9a5292b1-2d29-4170-ac2c-2e6e881650d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:19.801008 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9a5292b1-2d29-4170-ac2c-2e6e881650d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:19.810237 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9a5292b1-2d29-4170-ac2c-2e6e881650d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:19.811695 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9a5292b1-2d29-4170-ac2c-2e6e881650d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:19.812925 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9a5292b1-2d29-4170-ac2c-2e6e881650d1 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1810 microversion: 2.20 time: 0.292293 Sep 19 12:34:19.813500 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 387/770] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:34:19 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1810 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:34:20.838858 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-69a6616a-da16-43df-ae55-acb5c5bf231e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:20.839572 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-69a6616a-da16-43df-ae55-acb5c5bf231e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:20.847247 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-69a6616a-da16-43df-ae55-acb5c5bf231e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:20.847820 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-69a6616a-da16-43df-ae55-acb5c5bf231e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:20.848332 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-69a6616a-da16-43df-ae55-acb5c5bf231e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:20.849057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-69a6616a-da16-43df-ae55-acb5c5bf231e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:20.849503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-69a6616a-da16-43df-ae55-acb5c5bf231e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:20.849920 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-69a6616a-da16-43df-ae55-acb5c5bf231e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:20.984438 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-69a6616a-da16-43df-ae55-acb5c5bf231e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:20.993870 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-69a6616a-da16-43df-ae55-acb5c5bf231e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:20.995309 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-69a6616a-da16-43df-ae55-acb5c5bf231e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:20.996477 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-69a6616a-da16-43df-ae55-acb5c5bf231e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1810 microversion: 2.20 time: 0.161937 Sep 19 12:34:20.997249 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 384/771] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:34:20 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:34:22.022442 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-42357a35-f0d3-49bf-be57-cc7ee680b0d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:22.022994 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-42357a35-f0d3-49bf-be57-cc7ee680b0d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:22.030367 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-42357a35-f0d3-49bf-be57-cc7ee680b0d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:22.030852 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-42357a35-f0d3-49bf-be57-cc7ee680b0d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:22.031277 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-42357a35-f0d3-49bf-be57-cc7ee680b0d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:22.031964 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-42357a35-f0d3-49bf-be57-cc7ee680b0d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:22.032412 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-42357a35-f0d3-49bf-be57-cc7ee680b0d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:22.032864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-42357a35-f0d3-49bf-be57-cc7ee680b0d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:22.160332 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-42357a35-f0d3-49bf-be57-cc7ee680b0d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:22.169626 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-42357a35-f0d3-49bf-be57-cc7ee680b0d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:22.170487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-42357a35-f0d3-49bf-be57-cc7ee680b0d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:22.171658 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-42357a35-f0d3-49bf-be57-cc7ee680b0d7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1797 microversion: 2.20 time: 0.153289 Sep 19 12:34:22.172241 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 388/772] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:34:22 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1797 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:34:30.606523 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d2d71426-efa1-47a3-8cb4-c2b089af4ba9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1374223750", "imageRef": "d4301833-8e96-46bf-a940-692f93f7fdba", "flavorRef": "452", "networks": [{"uuid": "da226559-99ea-41b1-8942-bdd453f99fd3"}]}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:30.664049 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.network.neutron [None req-d2d71426-efa1-47a3-8cb4-c2b089af4ba9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] validate_networks() for [('da226559-99ea-41b1-8942-bdd453f99fd3', None, None, None, None, None)] {{(pid=121428) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:34:30.989080 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=12 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:31.029664 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-d2d71426-efa1-47a3-8cb4-c2b089af4ba9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Flavor limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:34:31.030096 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-d2d71426-efa1-47a3-8cb4-c2b089af4ba9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Image limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:34:31.030595 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-d2d71426-efa1-47a3-8cb4-c2b089af4ba9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Flavor pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:34:31.030976 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-d2d71426-efa1-47a3-8cb4-c2b089af4ba9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Image pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:34:31.031386 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-d2d71426-efa1-47a3-8cb4-c2b089af4ba9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:34:31.040157 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d2d71426-efa1-47a3-8cb4-c2b089af4ba9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:31.040684 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d2d71426-efa1-47a3-8cb4-c2b089af4ba9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:31.041120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d2d71426-efa1-47a3-8cb4-c2b089af4ba9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:31.041852 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d2d71426-efa1-47a3-8cb4-c2b089af4ba9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:31.042295 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d2d71426-efa1-47a3-8cb4-c2b089af4ba9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:31.042727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d2d71426-efa1-47a3-8cb4-c2b089af4ba9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:31.059709 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-d2d71426-efa1-47a3-8cb4-c2b089af4ba9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Getting quotas for project 6d9c692267e643c5b0e2b8ee8cdc85fe. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:34:31.063695 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-d2d71426-efa1-47a3-8cb4-c2b089af4ba9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Getting quotas for user 766abab8ce04417b83175b7a4a8d5f0f and project 6d9c692267e643c5b0e2b8ee8cdc85fe. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:34:31.076467 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d2d71426-efa1-47a3-8cb4-c2b089af4ba9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Going to run 1 instances... {{(pid=121428) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:34:31.079020 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d2d71426-efa1-47a3-8cb4-c2b089af4ba9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4301833-8e96-46bf-a940-692f93f7fdba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:34:31.270114 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d2d71426-efa1-47a3-8cb4-c2b089af4ba9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667513 Sep 19 12:34:31.277529 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 385/773] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:34:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 12:34:31.285289 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-7d749599-ade8-4974-9206-b8db2f932540 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:31.285959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-7d749599-ade8-4974-9206-b8db2f932540 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:31.353906 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-7d749599-ade8-4974-9206-b8db2f932540 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:31.366901 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-7d749599-ade8-4974-9206-b8db2f932540 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 200 len: 1219 microversion: 2.1 time: 0.088012 Sep 19 12:34:31.380638 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 389/774] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:31 2022] GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:32.393998 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-1ae532a3-1a43-4a32-b8c2-1272b2b3e54e tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:32.394613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-1ae532a3-1a43-4a32-b8c2-1272b2b3e54e tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:32.450178 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-1ae532a3-1a43-4a32-b8c2-1272b2b3e54e tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:32.460920 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-1ae532a3-1a43-4a32-b8c2-1272b2b3e54e tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 200 len: 1219 microversion: 2.1 time: 0.068149 Sep 19 12:34:32.460920 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 386/775] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:32 2022] GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:33.482001 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-d26d3ed0-0521-4b50-b96a-37882f4a7048 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:33.482655 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-d26d3ed0-0521-4b50-b96a-37882f4a7048 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:33.484504 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=24 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:33.491039 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d26d3ed0-0521-4b50-b96a-37882f4a7048 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:33.491525 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d26d3ed0-0521-4b50-b96a-37882f4a7048 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:33.491960 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d26d3ed0-0521-4b50-b96a-37882f4a7048 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:33.492718 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d26d3ed0-0521-4b50-b96a-37882f4a7048 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:33.493182 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d26d3ed0-0521-4b50-b96a-37882f4a7048 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:33.493592 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d26d3ed0-0521-4b50-b96a-37882f4a7048 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:33.559248 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-d26d3ed0-0521-4b50-b96a-37882f4a7048 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:33.567110 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-d26d3ed0-0521-4b50-b96a-37882f4a7048 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 200 len: 1271 microversion: 2.1 time: 0.089569 Sep 19 12:34:33.567674 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 390/776] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:33 2022] GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:34.591931 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-6a7af980-5167-457d-b0c4-0e474784c176 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:34.593320 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6a7af980-5167-457d-b0c4-0e474784c176 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:34.600051 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6a7af980-5167-457d-b0c4-0e474784c176 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:34.600619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6a7af980-5167-457d-b0c4-0e474784c176 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:34.601071 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6a7af980-5167-457d-b0c4-0e474784c176 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:34.601782 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6a7af980-5167-457d-b0c4-0e474784c176 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:34.602904 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6a7af980-5167-457d-b0c4-0e474784c176 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:34.603187 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6a7af980-5167-457d-b0c4-0e474784c176 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:34.754433 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-6a7af980-5167-457d-b0c4-0e474784c176 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:34.764211 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-6a7af980-5167-457d-b0c4-0e474784c176 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 200 len: 1319 microversion: 2.1 time: 0.176569 Sep 19 12:34:34.764853 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 387/777] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:34 2022] GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:35.611581 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-0ca6ea82-cbf9-4216-8a63-64392ad774a8 req-4fd16c44-dd59-4b8b-ae97-12e587ee83d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b67a92a-d614-4910-be26-d142a83d03f3", "tag": "eacbc8a6-6f65-49b9-b2d5-21c5309b7686"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:35.622041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-0ca6ea82-cbf9-4216-8a63-64392ad774a8 req-4fd16c44-dd59-4b8b-ae97-12e587ee83d7 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:35.622526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-0ca6ea82-cbf9-4216-8a63-64392ad774a8 req-4fd16c44-dd59-4b8b-ae97-12e587ee83d7 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:35.622964 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-0ca6ea82-cbf9-4216-8a63-64392ad774a8 req-4fd16c44-dd59-4b8b-ae97-12e587ee83d7 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:35.637176 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-0ca6ea82-cbf9-4216-8a63-64392ad774a8 req-4fd16c44-dd59-4b8b-ae97-12e587ee83d7 service nova] Creating event network-changed:eacbc8a6-6f65-49b9-b2d5-21c5309b7686 for instance 9b67a92a-d614-4910-be26-d142a83d03f3 on hv-cinder-85061 Sep 19 12:34:35.642700 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-0ca6ea82-cbf9-4216-8a63-64392ad774a8 req-4fd16c44-dd59-4b8b-ae97-12e587ee83d7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035295 Sep 19 12:34:35.643308 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 391/778] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:34:35.788084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-95e28b1e-f52d-4365-be76-05f481468089 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:35.788893 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-95e28b1e-f52d-4365-be76-05f481468089 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:35.795984 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-95e28b1e-f52d-4365-be76-05f481468089 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:35.796470 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-95e28b1e-f52d-4365-be76-05f481468089 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:35.796969 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-95e28b1e-f52d-4365-be76-05f481468089 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:35.797670 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-95e28b1e-f52d-4365-be76-05f481468089 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:35.798118 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-95e28b1e-f52d-4365-be76-05f481468089 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:35.798550 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-95e28b1e-f52d-4365-be76-05f481468089 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:36.003728 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-95e28b1e-f52d-4365-be76-05f481468089 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:36.012714 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-95e28b1e-f52d-4365-be76-05f481468089 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 200 len: 1319 microversion: 2.1 time: 0.228495 Sep 19 12:34:36.013337 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 388/779] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:35 2022] GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:37.038222 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-22ebbdd1-f128-420f-9237-d3fba734653b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:37.038927 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-22ebbdd1-f128-420f-9237-d3fba734653b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:37.045065 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-22ebbdd1-f128-420f-9237-d3fba734653b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:37.047223 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-22ebbdd1-f128-420f-9237-d3fba734653b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:37.047223 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-22ebbdd1-f128-420f-9237-d3fba734653b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:37.047223 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-22ebbdd1-f128-420f-9237-d3fba734653b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:37.047223 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-22ebbdd1-f128-420f-9237-d3fba734653b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:37.047606 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-22ebbdd1-f128-420f-9237-d3fba734653b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:37.178247 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-22ebbdd1-f128-420f-9237-d3fba734653b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:37.186525 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-22ebbdd1-f128-420f-9237-d3fba734653b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 200 len: 1319 microversion: 2.1 time: 0.153131 Sep 19 12:34:37.187096 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 392/780] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:37 2022] GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:38.210302 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-df0c471b-c872-47c7-ac31-070fd6fdb21d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:38.210931 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-df0c471b-c872-47c7-ac31-070fd6fdb21d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:38.217464 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-df0c471b-c872-47c7-ac31-070fd6fdb21d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:38.217969 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-df0c471b-c872-47c7-ac31-070fd6fdb21d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:38.218402 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-df0c471b-c872-47c7-ac31-070fd6fdb21d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:38.219086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-df0c471b-c872-47c7-ac31-070fd6fdb21d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:38.219538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-df0c471b-c872-47c7-ac31-070fd6fdb21d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:38.219955 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-df0c471b-c872-47c7-ac31-070fd6fdb21d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:38.347890 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-df0c471b-c872-47c7-ac31-070fd6fdb21d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:38.355631 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-df0c471b-c872-47c7-ac31-070fd6fdb21d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 200 len: 1319 microversion: 2.1 time: 0.149338 Sep 19 12:34:38.356221 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 389/781] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:38 2022] GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:39.379826 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2583e495-82b1-4257-ae74-bcdfaecfd841 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:39.380431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2583e495-82b1-4257-ae74-bcdfaecfd841 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:39.387258 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2583e495-82b1-4257-ae74-bcdfaecfd841 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:39.387741 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2583e495-82b1-4257-ae74-bcdfaecfd841 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:39.388181 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2583e495-82b1-4257-ae74-bcdfaecfd841 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:39.388892 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2583e495-82b1-4257-ae74-bcdfaecfd841 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:39.389347 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2583e495-82b1-4257-ae74-bcdfaecfd841 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:39.389773 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2583e495-82b1-4257-ae74-bcdfaecfd841 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:39.521040 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2583e495-82b1-4257-ae74-bcdfaecfd841 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:39.529636 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2583e495-82b1-4257-ae74-bcdfaecfd841 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 200 len: 1319 microversion: 2.1 time: 0.153652 Sep 19 12:34:39.535927 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 393/782] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:39 2022] GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:40.553415 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-7456a42c-4db2-4432-aff7-9a7f5bf63980 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:40.554005 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-7456a42c-4db2-4432-aff7-9a7f5bf63980 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:40.560978 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7456a42c-4db2-4432-aff7-9a7f5bf63980 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:40.561450 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7456a42c-4db2-4432-aff7-9a7f5bf63980 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:40.561873 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7456a42c-4db2-4432-aff7-9a7f5bf63980 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:40.562548 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7456a42c-4db2-4432-aff7-9a7f5bf63980 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:40.562993 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7456a42c-4db2-4432-aff7-9a7f5bf63980 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:40.563428 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7456a42c-4db2-4432-aff7-9a7f5bf63980 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:40.693871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-7456a42c-4db2-4432-aff7-9a7f5bf63980 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:40.701626 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-7456a42c-4db2-4432-aff7-9a7f5bf63980 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 200 len: 1319 microversion: 2.1 time: 0.152140 Sep 19 12:34:40.702190 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 390/783] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:40 2022] GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:41.056096 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-bbd2d050-477f-4b8b-b1b0-7d437d36a36e req-95f6a38c-07fb-432c-81f7-e7ee839403a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b67a92a-d614-4910-be26-d142a83d03f3", "name": "network-vif-plugged", "status": "completed", "tag": "eacbc8a6-6f65-49b9-b2d5-21c5309b7686"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:41.066133 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-bbd2d050-477f-4b8b-b1b0-7d437d36a36e req-95f6a38c-07fb-432c-81f7-e7ee839403a3 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:41.066625 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-bbd2d050-477f-4b8b-b1b0-7d437d36a36e req-95f6a38c-07fb-432c-81f7-e7ee839403a3 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:41.067158 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-bbd2d050-477f-4b8b-b1b0-7d437d36a36e req-95f6a38c-07fb-432c-81f7-e7ee839403a3 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:41.078636 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-bbd2d050-477f-4b8b-b1b0-7d437d36a36e req-95f6a38c-07fb-432c-81f7-e7ee839403a3 service nova] Creating event network-vif-plugged:eacbc8a6-6f65-49b9-b2d5-21c5309b7686 for instance 9b67a92a-d614-4910-be26-d142a83d03f3 on hv-cinder-85061 Sep 19 12:34:41.083680 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-bbd2d050-477f-4b8b-b1b0-7d437d36a36e req-95f6a38c-07fb-432c-81f7-e7ee839403a3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031279 Sep 19 12:34:41.084359 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 394/784] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:34:41.724384 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-71ba222b-b95a-47a2-83fb-b6a0b39af7d2 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:41.724977 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-71ba222b-b95a-47a2-83fb-b6a0b39af7d2 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:41.726798 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=2 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:41.731968 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-71ba222b-b95a-47a2-83fb-b6a0b39af7d2 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:41.732443 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-71ba222b-b95a-47a2-83fb-b6a0b39af7d2 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:41.732904 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-71ba222b-b95a-47a2-83fb-b6a0b39af7d2 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:41.733584 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-71ba222b-b95a-47a2-83fb-b6a0b39af7d2 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:41.734030 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-71ba222b-b95a-47a2-83fb-b6a0b39af7d2 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:41.734446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-71ba222b-b95a-47a2-83fb-b6a0b39af7d2 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:41.865765 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-71ba222b-b95a-47a2-83fb-b6a0b39af7d2 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:41.874132 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-71ba222b-b95a-47a2-83fb-b6a0b39af7d2 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 200 len: 1319 microversion: 2.1 time: 0.153855 Sep 19 12:34:41.874709 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 391/785] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:41 2022] GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:42.894855 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=2 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:42.900077 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-de526eb3-47db-4d4e-8e8b-5c9f66155e1b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:42.900810 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-de526eb3-47db-4d4e-8e8b-5c9f66155e1b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:42.906972 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-de526eb3-47db-4d4e-8e8b-5c9f66155e1b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:42.907448 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-de526eb3-47db-4d4e-8e8b-5c9f66155e1b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:42.907884 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-de526eb3-47db-4d4e-8e8b-5c9f66155e1b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:42.908621 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-de526eb3-47db-4d4e-8e8b-5c9f66155e1b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:42.909084 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-de526eb3-47db-4d4e-8e8b-5c9f66155e1b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:42.909507 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-de526eb3-47db-4d4e-8e8b-5c9f66155e1b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:43.041913 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-de526eb3-47db-4d4e-8e8b-5c9f66155e1b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:43.049702 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-de526eb3-47db-4d4e-8e8b-5c9f66155e1b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 200 len: 1319 microversion: 2.1 time: 0.155826 Sep 19 12:34:43.050253 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 395/786] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:42 2022] GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:44.072659 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c9872ec0-7b86-4b6c-84bd-af6377a2445b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:44.073266 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c9872ec0-7b86-4b6c-84bd-af6377a2445b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:44.075055 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=8 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:44.080177 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c9872ec0-7b86-4b6c-84bd-af6377a2445b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:44.080677 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c9872ec0-7b86-4b6c-84bd-af6377a2445b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:44.081107 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c9872ec0-7b86-4b6c-84bd-af6377a2445b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:44.081858 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c9872ec0-7b86-4b6c-84bd-af6377a2445b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:44.082296 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c9872ec0-7b86-4b6c-84bd-af6377a2445b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:44.082709 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c9872ec0-7b86-4b6c-84bd-af6377a2445b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:44.214806 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c9872ec0-7b86-4b6c-84bd-af6377a2445b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:44.222338 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c9872ec0-7b86-4b6c-84bd-af6377a2445b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 200 len: 1319 microversion: 2.1 time: 0.154137 Sep 19 12:34:44.222896 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 392/787] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:44 2022] GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:45.245822 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-1c28bc25-93da-4983-842a-6e3840025b71 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:45.246415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-1c28bc25-93da-4983-842a-6e3840025b71 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:45.253030 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c28bc25-93da-4983-842a-6e3840025b71 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:45.253518 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c28bc25-93da-4983-842a-6e3840025b71 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:45.253944 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c28bc25-93da-4983-842a-6e3840025b71 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:45.254702 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c28bc25-93da-4983-842a-6e3840025b71 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:45.255154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c28bc25-93da-4983-842a-6e3840025b71 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:45.255576 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c28bc25-93da-4983-842a-6e3840025b71 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:45.400287 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-1c28bc25-93da-4983-842a-6e3840025b71 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:45.408421 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-1c28bc25-93da-4983-842a-6e3840025b71 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 200 len: 1319 microversion: 2.1 time: 0.166342 Sep 19 12:34:45.409146 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 396/788] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:45 2022] GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:46.432849 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-65217f7c-81c1-44eb-86c7-0461a26683bf tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:46.433387 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-65217f7c-81c1-44eb-86c7-0461a26683bf tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:46.440015 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65217f7c-81c1-44eb-86c7-0461a26683bf tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:46.440495 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65217f7c-81c1-44eb-86c7-0461a26683bf tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:46.440962 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65217f7c-81c1-44eb-86c7-0461a26683bf tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:46.441643 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65217f7c-81c1-44eb-86c7-0461a26683bf tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:46.442085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65217f7c-81c1-44eb-86c7-0461a26683bf tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:46.442496 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65217f7c-81c1-44eb-86c7-0461a26683bf tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:46.576627 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-65217f7c-81c1-44eb-86c7-0461a26683bf tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:46.584544 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-65217f7c-81c1-44eb-86c7-0461a26683bf tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 200 len: 1509 microversion: 2.1 time: 0.156198 Sep 19 12:34:46.585193 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 393/789] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:46 2022] GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:02.280585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4c40b135-2efc-415a-a6f6-cc337e468261 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:02.282014 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4c40b135-2efc-415a-a6f6-cc337e468261 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:02.287060 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:35:02.287262 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Mon Sep 19 12:35:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/os-volume_attachments/c8473465-ed74-464e-ad5f-c29f9bd927d6 (ip 10.222.0.93) !!! Sep 19 12:35:02.288745 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=21 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:02.289505 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=34 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:02.292557 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4c40b135-2efc-415a-a6f6-cc337e468261 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:02.293164 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4c40b135-2efc-415a-a6f6-cc337e468261 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:02.293716 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4c40b135-2efc-415a-a6f6-cc337e468261 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:02.294495 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4c40b135-2efc-415a-a6f6-cc337e468261 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:02.295027 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4c40b135-2efc-415a-a6f6-cc337e468261 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:02.295522 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4c40b135-2efc-415a-a6f6-cc337e468261 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:02.328115 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4c40b135-2efc-415a-a6f6-cc337e468261 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/os-volume_attachments/c8473465-ed74-464e-ad5f-c29f9bd927d6" status: 200 len: 194 microversion: 2.20 time: 0.052723 Sep 19 12:35:02.328766 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 397/790] 10.222.0.93 () {60 vars in 1454 bytes} [Mon Sep 19 12:35:02 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/os-volume_attachments/c8473465-ed74-464e-ad5f-c29f9bd927d6 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:35:02.402301 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-815aeb85-d740-426d-a780-8c5a10806a72 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:02.402887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-815aeb85-d740-426d-a780-8c5a10806a72 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:02.405707 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:02.406379 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=44 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:02.411546 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-815aeb85-d740-426d-a780-8c5a10806a72 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:02.412112 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-815aeb85-d740-426d-a780-8c5a10806a72 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:02.412552 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-815aeb85-d740-426d-a780-8c5a10806a72 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:02.420628 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-815aeb85-d740-426d-a780-8c5a10806a72 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:02.420628 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-815aeb85-d740-426d-a780-8c5a10806a72 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:02.420628 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-815aeb85-d740-426d-a780-8c5a10806a72 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:02.499139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-815aeb85-d740-426d-a780-8c5a10806a72 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lazy-loading 'services' on Instance uuid 7c5331a8-de67-49e9-a0f6-96c8a1915492 {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:35:02.717364 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-815aeb85-d740-426d-a780-8c5a10806a72 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/os-volume_attachments/c8473465-ed74-464e-ad5f-c29f9bd927d6" status: 202 len: 0 microversion: 2.20 time: 0.319407 Sep 19 12:35:02.718019 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 394/791] 10.222.0.93 () {60 vars in 1457 bytes} [Mon Sep 19 12:35:02 2022] DELETE /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/os-volume_attachments/c8473465-ed74-464e-ad5f-c29f9bd927d6 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:35:02.727958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-81b9322e-75d9-4d83-917e-b7d25eb009da tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:02.730426 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-81b9322e-75d9-4d83-917e-b7d25eb009da tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:02.736812 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-81b9322e-75d9-4d83-917e-b7d25eb009da tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:02.737369 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-81b9322e-75d9-4d83-917e-b7d25eb009da tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:02.737789 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-81b9322e-75d9-4d83-917e-b7d25eb009da tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:02.738498 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-81b9322e-75d9-4d83-917e-b7d25eb009da tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:02.739178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-81b9322e-75d9-4d83-917e-b7d25eb009da tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:02.739575 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-81b9322e-75d9-4d83-917e-b7d25eb009da tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:02.771468 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-81b9322e-75d9-4d83-917e-b7d25eb009da tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048833 Sep 19 12:35:02.771939 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 398/792] 10.222.0.93 () {60 vars in 1343 bytes} [Mon Sep 19 12:35:02 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:35:03.322580 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e1ff61e7-4dc2-40eb-ad8d-aa338da4ab77 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43143c74-bf92-4d0c-850d-35939aa04c9a", "device": "/dev/sdb"}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:03.333801 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e1ff61e7-4dc2-40eb-ad8d-aa338da4ab77 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:03.333801 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e1ff61e7-4dc2-40eb-ad8d-aa338da4ab77 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:03.333801 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e1ff61e7-4dc2-40eb-ad8d-aa338da4ab77 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:03.334274 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e1ff61e7-4dc2-40eb-ad8d-aa338da4ab77 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:03.334982 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e1ff61e7-4dc2-40eb-ad8d-aa338da4ab77 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:03.335433 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e1ff61e7-4dc2-40eb-ad8d-aa338da4ab77 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:03.336406 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e1ff61e7-4dc2-40eb-ad8d-aa338da4ab77 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:03.785547 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4593c8c3-1d6b-4b48-a55c-658d00992db7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:03.787715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4593c8c3-1d6b-4b48-a55c-658d00992db7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:03.793931 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4593c8c3-1d6b-4b48-a55c-658d00992db7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:03.794457 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4593c8c3-1d6b-4b48-a55c-658d00992db7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:03.794889 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4593c8c3-1d6b-4b48-a55c-658d00992db7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:03.795578 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4593c8c3-1d6b-4b48-a55c-658d00992db7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:03.796017 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4593c8c3-1d6b-4b48-a55c-658d00992db7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:03.796433 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4593c8c3-1d6b-4b48-a55c-658d00992db7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:03.829833 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4593c8c3-1d6b-4b48-a55c-658d00992db7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049049 Sep 19 12:35:03.830508 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 399/793] 10.222.0.93 () {60 vars in 1343 bytes} [Mon Sep 19 12:35:03 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:35:04.133975 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e1ff61e7-4dc2-40eb-ad8d-aa338da4ab77 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "POST /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.815796 Sep 19 12:35:04.134788 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 395/794] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Sep 19 12:35:03 2022] POST /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3/os-volume_attachments => generated 194 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:35:04.843452 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5fc0e972-9bdf-44d6-9aa7-b387914d4a6f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:04.845712 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-5fc0e972-9bdf-44d6-9aa7-b387914d4a6f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:04.853121 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5fc0e972-9bdf-44d6-9aa7-b387914d4a6f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:04.853596 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5fc0e972-9bdf-44d6-9aa7-b387914d4a6f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:04.854030 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5fc0e972-9bdf-44d6-9aa7-b387914d4a6f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:04.854728 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5fc0e972-9bdf-44d6-9aa7-b387914d4a6f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:04.855177 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5fc0e972-9bdf-44d6-9aa7-b387914d4a6f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:04.855595 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5fc0e972-9bdf-44d6-9aa7-b387914d4a6f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:04.889866 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5fc0e972-9bdf-44d6-9aa7-b387914d4a6f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050489 Sep 19 12:35:04.890508 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 400/795] 10.222.0.93 () {60 vars in 1343 bytes} [Mon Sep 19 12:35:04 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:05.081833 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a9625dbd-0575-49fa-b10d-5ec84ab13624 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:05.082323 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a9625dbd-0575-49fa-b10d-5ec84ab13624 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:05.089041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9625dbd-0575-49fa-b10d-5ec84ab13624 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:05.089520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9625dbd-0575-49fa-b10d-5ec84ab13624 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:05.089957 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9625dbd-0575-49fa-b10d-5ec84ab13624 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:05.090633 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9625dbd-0575-49fa-b10d-5ec84ab13624 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:05.091138 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9625dbd-0575-49fa-b10d-5ec84ab13624 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:05.091494 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9625dbd-0575-49fa-b10d-5ec84ab13624 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:05.119417 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a9625dbd-0575-49fa-b10d-5ec84ab13624 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Going to try to terminate instance {{(pid=121428) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:35:05.467365 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a9625dbd-0575-49fa-b10d-5ec84ab13624 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 204 len: 0 microversion: 2.20 time: 0.389970 Sep 19 12:35:05.468038 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 396/796] 10.222.0.93 () {60 vars in 1280 bytes} [Mon Sep 19 12:35:05 2022] DELETE /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 12:35:05.476781 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-33c47247-0e57-4a03-8e39-62cc795b8134 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:05.477441 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-33c47247-0e57-4a03-8e39-62cc795b8134 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:05.483520 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33c47247-0e57-4a03-8e39-62cc795b8134 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:05.484013 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33c47247-0e57-4a03-8e39-62cc795b8134 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:05.484446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33c47247-0e57-4a03-8e39-62cc795b8134 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:05.485202 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33c47247-0e57-4a03-8e39-62cc795b8134 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:05.485648 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33c47247-0e57-4a03-8e39-62cc795b8134 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:05.486075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-33c47247-0e57-4a03-8e39-62cc795b8134 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:05.631523 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-33c47247-0e57-4a03-8e39-62cc795b8134 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:05.648518 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-33c47247-0e57-4a03-8e39-62cc795b8134 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:05.651402 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-33c47247-0e57-4a03-8e39-62cc795b8134 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:05.655777 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-33c47247-0e57-4a03-8e39-62cc795b8134 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1725 microversion: 2.20 time: 0.180528 Sep 19 12:35:05.655777 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 401/797] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:05 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:35:06.680831 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-56eeeae0-752a-469f-816d-8f65bf6bdfbb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:06.681673 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-56eeeae0-752a-469f-816d-8f65bf6bdfbb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:06.688285 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-56eeeae0-752a-469f-816d-8f65bf6bdfbb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:06.688721 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-56eeeae0-752a-469f-816d-8f65bf6bdfbb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:06.689203 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-56eeeae0-752a-469f-816d-8f65bf6bdfbb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:06.689890 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-56eeeae0-752a-469f-816d-8f65bf6bdfbb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:06.690329 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-56eeeae0-752a-469f-816d-8f65bf6bdfbb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:06.690744 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-56eeeae0-752a-469f-816d-8f65bf6bdfbb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:06.821002 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-56eeeae0-752a-469f-816d-8f65bf6bdfbb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:06.829533 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-56eeeae0-752a-469f-816d-8f65bf6bdfbb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:06.832412 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-56eeeae0-752a-469f-816d-8f65bf6bdfbb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:06.832412 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-56eeeae0-752a-469f-816d-8f65bf6bdfbb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1725 microversion: 2.20 time: 0.156394 Sep 19 12:35:06.832831 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 397/798] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:06 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:35:07.857722 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-38196f0c-35dd-428e-be41-9cfb89942fc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:07.858370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-38196f0c-35dd-428e-be41-9cfb89942fc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:07.864983 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-38196f0c-35dd-428e-be41-9cfb89942fc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:07.867269 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-38196f0c-35dd-428e-be41-9cfb89942fc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:07.867269 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-38196f0c-35dd-428e-be41-9cfb89942fc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:07.867269 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-38196f0c-35dd-428e-be41-9cfb89942fc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:07.867727 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-38196f0c-35dd-428e-be41-9cfb89942fc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:07.867989 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-38196f0c-35dd-428e-be41-9cfb89942fc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:07.951522 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-38196f0c-35dd-428e-be41-9cfb89942fc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:07.960874 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-38196f0c-35dd-428e-be41-9cfb89942fc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:07.962338 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-38196f0c-35dd-428e-be41-9cfb89942fc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:07.963518 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-38196f0c-35dd-428e-be41-9cfb89942fc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1657 microversion: 2.20 time: 0.109759 Sep 19 12:35:07.964296 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 402/799] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:07 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1657 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:35:08.284879 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-859420ab-d324-41a2-b5f5-4121ed1a0f0e req-d91f3fbf-2737-4993-ac8a-c43a1f83a067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c5331a8-de67-49e9-a0f6-96c8a1915492", "name": "network-vif-deleted", "tag": "760b99b4-defc-4bbb-86a7-39ce573ef1d4"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:08.297109 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-859420ab-d324-41a2-b5f5-4121ed1a0f0e req-d91f3fbf-2737-4993-ac8a-c43a1f83a067 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:08.297586 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-859420ab-d324-41a2-b5f5-4121ed1a0f0e req-d91f3fbf-2737-4993-ac8a-c43a1f83a067 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:08.298018 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-859420ab-d324-41a2-b5f5-4121ed1a0f0e req-d91f3fbf-2737-4993-ac8a-c43a1f83a067 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:08.318715 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-859420ab-d324-41a2-b5f5-4121ed1a0f0e req-d91f3fbf-2737-4993-ac8a-c43a1f83a067 service nova] Creating event network-vif-deleted:760b99b4-defc-4bbb-86a7-39ce573ef1d4 for instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 on hv-cinder-85061 Sep 19 12:35:08.331366 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-859420ab-d324-41a2-b5f5-4121ed1a0f0e req-d91f3fbf-2737-4993-ac8a-c43a1f83a067 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062000 Sep 19 12:35:08.333353 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 398/800] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:35:08.990837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b06b98bd-e399-4638-8bd9-bc559e99fcf8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:08.995433 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b06b98bd-e399-4638-8bd9-bc559e99fcf8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:08.998426 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b06b98bd-e399-4638-8bd9-bc559e99fcf8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:08.998914 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b06b98bd-e399-4638-8bd9-bc559e99fcf8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:08.999356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b06b98bd-e399-4638-8bd9-bc559e99fcf8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:09.000156 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b06b98bd-e399-4638-8bd9-bc559e99fcf8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:09.000625 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b06b98bd-e399-4638-8bd9-bc559e99fcf8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:09.001095 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b06b98bd-e399-4638-8bd9-bc559e99fcf8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:09.036685 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b06b98bd-e399-4638-8bd9-bc559e99fcf8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:09.037187 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b06b98bd-e399-4638-8bd9-bc559e99fcf8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:09.037618 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b06b98bd-e399-4638-8bd9-bc559e99fcf8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:09.043347 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.objects.instance [None req-b06b98bd-e399-4638-8bd9-bc559e99fcf8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lazy-loading 'fault' on Instance uuid 7c5331a8-de67-49e9-a0f6-96c8a1915492 {{(pid=121429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:35:09.079733 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-b06b98bd-e399-4638-8bd9-bc559e99fcf8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:09.088847 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-b06b98bd-e399-4638-8bd9-bc559e99fcf8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:09.090318 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-b06b98bd-e399-4638-8bd9-bc559e99fcf8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:09.091498 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-b06b98bd-e399-4638-8bd9-bc559e99fcf8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 200 len: 1372 microversion: 2.20 time: 0.104593 Sep 19 12:35:09.092316 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 403/801] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:08 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:35:10.118667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-3a11a8a4-fc6e-4dea-b392-dea6a9b7a6cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:10.119350 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-3a11a8a4-fc6e-4dea-b392-dea6a9b7a6cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:10.125932 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3a11a8a4-fc6e-4dea-b392-dea6a9b7a6cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:10.126443 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3a11a8a4-fc6e-4dea-b392-dea6a9b7a6cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:10.126878 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3a11a8a4-fc6e-4dea-b392-dea6a9b7a6cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:10.127558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3a11a8a4-fc6e-4dea-b392-dea6a9b7a6cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:10.128000 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3a11a8a4-fc6e-4dea-b392-dea6a9b7a6cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:10.128415 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3a11a8a4-fc6e-4dea-b392-dea6a9b7a6cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:10.141583 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-3a11a8a4-fc6e-4dea-b392-dea6a9b7a6cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] HTTP exception thrown: Instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 could not be found. Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-3a11a8a4-fc6e-4dea-b392-dea6a9b7a6cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Request method failure captured: Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 HTTP/1.1 Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKGFFQsmBjto4PE6FHYEIOW-f-Y0xL-ZgRHhS_DJYbN7UZMVOSUj-nR7xeJ56Tyr3xv-CyRMbA0kM5YTZh7ROrQNA5bHf6mt63iR5GPVljEWXD-oD-lOgYlSns4GueBMxiZyo59uPU9c5ns8gYCGRp2-pq9TVmYRpihvuBtUEV_M0CvE Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 6316917c9ff94be4bed47eb0b60e7f33 Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1443879091 Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:35:10.143199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:35:10.150031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6316917c9ff94be4bed47eb0b60e7f33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6316917c9ff94be4bed47eb0b60e7f33", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6316917c9ff94be4bed47eb0b60e7f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6316917c9ff94be4bed47eb0b60e7f33"}]}] Sep 19 12:35:10.150031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1443879091 Sep 19 12:35:10.150031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 6316917c9ff94be4bed47eb0b60e7f33 Sep 19 12:35:10.150031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1443879091 Sep 19 12:35:10.150031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-AttachVolumeShelveTestJSON-1443879091-project Sep 19 12:35:10.150031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:35:10.150031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:35:10.150031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: c6f743b2ff4246d98700f57efedfcea2 Sep 19 12:35:10.150031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1443879091-project Sep 19 12:35:10.150031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:35:10.150031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 could not be found. Sep 19 12:35:10.150031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': '7c5331a8-de67-49e9-a0f6-96c8a1915492'} Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 could not be found. Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:35:10.151095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:35:10.152811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:35:10.152811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:35:10.152811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:35:10.152811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:35:10.152811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:35:10.152811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:35:10.152811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:35:10.152811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 could not be found. Sep 19 12:35:10.152811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:35:10.152811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:35:10.152811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:35:10.152811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:35:10.152811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:35:10.152811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:35:10.152811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:35:10.152811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:35:10.152811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 could not be found. Sep 19 12:35:10.152811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:35:10.154212 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-3a11a8a4-fc6e-4dea-b392-dea6a9b7a6cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Returning 404 to user: Instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:35:10.154212 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-3a11a8a4-fc6e-4dea-b392-dea6a9b7a6cd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 404 len: 111 microversion: 2.20 time: 0.030191 Sep 19 12:35:10.154212 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 399/802] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:10 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:35:10.154986 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-346cbc65-2bb9-4dbc-bbf3-dc2d09f6f58f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '.version_select at 0x7f54b339c820>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:10.233831 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-346cbc65-2bb9-4dbc-bbf3-dc2d09f6f58f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1216363609" status: 204 len: 0 microversion: 2.20 time: 0.083392 Sep 19 12:35:10.234721 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 404/803] 10.222.0.93 () {60 vars in 1262 bytes} [Mon Sep 19 12:35:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1216363609 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 12:35:11.180884 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ed79a86a-ffd2-44d2-8af1-ddba73b94904 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Action: 'create', calling method: .version_select at 0x7f54b3418ee0>, body: {"keypair": {"name": "tempest-keypair-575871374", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuPDQaSeXN2OMHAfV67fg54F3ZHnueG362pgKgCoYY8DXoNeGmrSHdA9it5c6FYOuXItINs4nsPwO9MkVIVtikACwQgJx3YC1eT44OcCORcBSMn7dTk31828SOEhkKccw=="}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:11.199372 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-ed79a86a-ffd2-44d2-8af1-ddba73b94904 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Getting quotas for project 6316917c9ff94be4bed47eb0b60e7f33. Resources: {'key_pairs'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:35:11.203917 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-ed79a86a-ffd2-44d2-8af1-ddba73b94904 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Getting quotas for user c6f743b2ff4246d98700f57efedfcea2 and project 6316917c9ff94be4bed47eb0b60e7f33. Resources: {'key_pairs'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:35:11.354069 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ed79a86a-ffd2-44d2-8af1-ddba73b94904 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.177612 Sep 19 12:35:11.354905 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 400/804] 10.222.0.93 () {62 vars in 1200 bytes} [Mon Sep 19 12:35:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 179 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 19 12:35:13.935804 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ec0b7f6c-3136-422e-9095-4660b3d4f1c8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-663226279", "imageRef": "d4301833-8e96-46bf-a940-692f93f7fdba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af5272e5-f954-494b-ac83-7c8776b2b4cb"}], "security_groups": [{"name": "tempest-securitygroup--1292034223"}], "key_name": "tempest-keypair-575871374", "user_data": "}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:14.042572 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.network.neutron [None req-ec0b7f6c-3136-422e-9095-4660b3d4f1c8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] validate_networks() for [('af5272e5-f954-494b-ac83-7c8776b2b4cb', None, None, None, None, None)] {{(pid=121429) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:35:14.430227 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-ec0b7f6c-3136-422e-9095-4660b3d4f1c8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Flavor limits 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:35:14.430658 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-ec0b7f6c-3136-422e-9095-4660b3d4f1c8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Image limits 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:35:14.431109 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-ec0b7f6c-3136-422e-9095-4660b3d4f1c8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Flavor pref 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:35:14.431511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-ec0b7f6c-3136-422e-9095-4660b3d4f1c8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Image pref 0:0:0 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:35:14.431933 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.virt.hardware [None req-ec0b7f6c-3136-422e-9095-4660b3d4f1c8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:35:14.440987 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ec0b7f6c-3136-422e-9095-4660b3d4f1c8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:14.444358 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ec0b7f6c-3136-422e-9095-4660b3d4f1c8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:14.444358 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ec0b7f6c-3136-422e-9095-4660b3d4f1c8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:14.444358 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ec0b7f6c-3136-422e-9095-4660b3d4f1c8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:14.444358 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ec0b7f6c-3136-422e-9095-4660b3d4f1c8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:14.444942 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ec0b7f6c-3136-422e-9095-4660b3d4f1c8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:14.461182 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-ec0b7f6c-3136-422e-9095-4660b3d4f1c8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Getting quotas for project 6316917c9ff94be4bed47eb0b60e7f33. Resources: {'instances', 'ram', 'cores'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:35:14.465503 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-ec0b7f6c-3136-422e-9095-4660b3d4f1c8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Getting quotas for user c6f743b2ff4246d98700f57efedfcea2 and project 6316917c9ff94be4bed47eb0b60e7f33. Resources: {'instances', 'ram', 'cores'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:35:14.477174 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ec0b7f6c-3136-422e-9095-4660b3d4f1c8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Going to run 1 instances... {{(pid=121429) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:35:14.479524 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ec0b7f6c-3136-422e-9095-4660b3d4f1c8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4301833-8e96-46bf-a940-692f93f7fdba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121429) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:35:14.724742 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ec0b7f6c-3136-422e-9095-4660b3d4f1c8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.793013 Sep 19 12:35:14.725582 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 405/805] 10.222.0.93 () {62 vars in 1188 bytes} [Mon Sep 19 12:35:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 12:35:14.737319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-6b9048f1-c3b8-4405-9c69-1c91fb64273e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:14.738017 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6b9048f1-c3b8-4405-9c69-1c91fb64273e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:14.797258 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-6b9048f1-c3b8-4405-9c69-1c91fb64273e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:14.805578 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-6b9048f1-c3b8-4405-9c69-1c91fb64273e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:14.807179 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-6b9048f1-c3b8-4405-9c69-1c91fb64273e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:14.808288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-6b9048f1-c3b8-4405-9c69-1c91fb64273e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1280 microversion: 2.20 time: 0.074924 Sep 19 12:35:14.823614 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 401/806] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:14 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:35:15.834271 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-0dd5206a-c324-4b38-83ba-4e8192a18395 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:15.834946 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-0dd5206a-c324-4b38-83ba-4e8192a18395 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:15.841458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0dd5206a-c324-4b38-83ba-4e8192a18395 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:15.841938 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0dd5206a-c324-4b38-83ba-4e8192a18395 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:15.846281 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0dd5206a-c324-4b38-83ba-4e8192a18395 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:15.846281 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0dd5206a-c324-4b38-83ba-4e8192a18395 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:15.846281 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0dd5206a-c324-4b38-83ba-4e8192a18395 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:15.846281 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0dd5206a-c324-4b38-83ba-4e8192a18395 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:15.905421 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-0dd5206a-c324-4b38-83ba-4e8192a18395 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:15.913912 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-0dd5206a-c324-4b38-83ba-4e8192a18395 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:15.915361 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-0dd5206a-c324-4b38-83ba-4e8192a18395 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:15.916490 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-0dd5206a-c324-4b38-83ba-4e8192a18395 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1284 microversion: 2.20 time: 0.086286 Sep 19 12:35:15.917070 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 406/807] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:15 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:35:16.941553 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-495bf0f3-d8aa-42c6-810a-706b1594ff48 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:16.942093 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-495bf0f3-d8aa-42c6-810a-706b1594ff48 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:16.949016 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-495bf0f3-d8aa-42c6-810a-706b1594ff48 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:16.949516 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-495bf0f3-d8aa-42c6-810a-706b1594ff48 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:16.949969 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-495bf0f3-d8aa-42c6-810a-706b1594ff48 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:16.950667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-495bf0f3-d8aa-42c6-810a-706b1594ff48 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:16.951114 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-495bf0f3-d8aa-42c6-810a-706b1594ff48 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:16.951539 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-495bf0f3-d8aa-42c6-810a-706b1594ff48 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:17.013629 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-495bf0f3-d8aa-42c6-810a-706b1594ff48 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:17.021768 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-495bf0f3-d8aa-42c6-810a-706b1594ff48 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:17.023219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-495bf0f3-d8aa-42c6-810a-706b1594ff48 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:17.024351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-495bf0f3-d8aa-42c6-810a-706b1594ff48 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1332 microversion: 2.20 time: 0.086768 Sep 19 12:35:17.024941 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 402/808] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:16 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1332 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:35:18.050396 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2bea77a9-0ac7-48fa-99c3-0a5823ebb293 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:18.051027 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2bea77a9-0ac7-48fa-99c3-0a5823ebb293 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:18.057353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2bea77a9-0ac7-48fa-99c3-0a5823ebb293 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:18.057859 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2bea77a9-0ac7-48fa-99c3-0a5823ebb293 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:18.058303 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2bea77a9-0ac7-48fa-99c3-0a5823ebb293 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:18.059036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2bea77a9-0ac7-48fa-99c3-0a5823ebb293 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:18.059492 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2bea77a9-0ac7-48fa-99c3-0a5823ebb293 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:18.059923 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2bea77a9-0ac7-48fa-99c3-0a5823ebb293 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:18.122879 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2bea77a9-0ac7-48fa-99c3-0a5823ebb293 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:18.131327 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2bea77a9-0ac7-48fa-99c3-0a5823ebb293 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:18.133347 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2bea77a9-0ac7-48fa-99c3-0a5823ebb293 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:18.134448 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2bea77a9-0ac7-48fa-99c3-0a5823ebb293 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1350 microversion: 2.20 time: 0.088031 Sep 19 12:35:18.135003 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 407/809] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:18 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:35:19.159455 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-aa70c3e8-6f01-47e0-913f-61b68920ca9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:19.159993 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-aa70c3e8-6f01-47e0-913f-61b68920ca9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:19.167345 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-aa70c3e8-6f01-47e0-913f-61b68920ca9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:19.167829 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-aa70c3e8-6f01-47e0-913f-61b68920ca9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:19.168262 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-aa70c3e8-6f01-47e0-913f-61b68920ca9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:19.169120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-aa70c3e8-6f01-47e0-913f-61b68920ca9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:19.169566 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-aa70c3e8-6f01-47e0-913f-61b68920ca9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:19.169989 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-aa70c3e8-6f01-47e0-913f-61b68920ca9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:19.302444 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-aa70c3e8-6f01-47e0-913f-61b68920ca9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:19.310799 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-aa70c3e8-6f01-47e0-913f-61b68920ca9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:19.312310 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-aa70c3e8-6f01-47e0-913f-61b68920ca9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:19.313476 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-aa70c3e8-6f01-47e0-913f-61b68920ca9a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1406 microversion: 2.20 time: 0.158034 Sep 19 12:35:19.314921 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 403/810] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:19 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:35:20.339992 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-145ffc0c-0d9e-4dd6-92e1-79854c47cdb0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:20.340632 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-145ffc0c-0d9e-4dd6-92e1-79854c47cdb0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:20.348228 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-145ffc0c-0d9e-4dd6-92e1-79854c47cdb0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:20.348633 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-145ffc0c-0d9e-4dd6-92e1-79854c47cdb0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:20.349062 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-145ffc0c-0d9e-4dd6-92e1-79854c47cdb0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:20.349767 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-145ffc0c-0d9e-4dd6-92e1-79854c47cdb0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:20.350218 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-145ffc0c-0d9e-4dd6-92e1-79854c47cdb0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:20.350641 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-145ffc0c-0d9e-4dd6-92e1-79854c47cdb0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:20.670644 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-145ffc0c-0d9e-4dd6-92e1-79854c47cdb0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:20.679392 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-145ffc0c-0d9e-4dd6-92e1-79854c47cdb0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:20.680922 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-145ffc0c-0d9e-4dd6-92e1-79854c47cdb0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:20.682103 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-145ffc0c-0d9e-4dd6-92e1-79854c47cdb0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1406 microversion: 2.20 time: 0.346126 Sep 19 12:35:20.682654 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 408/811] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:20 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:35:21.348094 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-c718c8cc-e1de-4a75-aafd-164f2c08aab9 req-f10d5455-8cf3-4b48-af55-434ced6c9e14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73260e21-141c-4941-bdbe-66ee0eeef141", "tag": "3bbecd75-6878-45e6-92b1-03e016e3daab"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:21.359021 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-c718c8cc-e1de-4a75-aafd-164f2c08aab9 req-f10d5455-8cf3-4b48-af55-434ced6c9e14 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:21.359576 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-c718c8cc-e1de-4a75-aafd-164f2c08aab9 req-f10d5455-8cf3-4b48-af55-434ced6c9e14 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:21.360298 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-c718c8cc-e1de-4a75-aafd-164f2c08aab9 req-f10d5455-8cf3-4b48-af55-434ced6c9e14 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:21.375203 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-c718c8cc-e1de-4a75-aafd-164f2c08aab9 req-f10d5455-8cf3-4b48-af55-434ced6c9e14 service nova] Creating event network-changed:3bbecd75-6878-45e6-92b1-03e016e3daab for instance 73260e21-141c-4941-bdbe-66ee0eeef141 on hv-cinder-85061 Sep 19 12:35:21.380302 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-c718c8cc-e1de-4a75-aafd-164f2c08aab9 req-f10d5455-8cf3-4b48-af55-434ced6c9e14 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038371 Sep 19 12:35:21.381369 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 404/812] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:35:21.708058 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-bc899a53-22dc-4e75-8dfc-9aa82bd9cd74 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:21.708815 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-bc899a53-22dc-4e75-8dfc-9aa82bd9cd74 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:21.714927 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bc899a53-22dc-4e75-8dfc-9aa82bd9cd74 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:21.715415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bc899a53-22dc-4e75-8dfc-9aa82bd9cd74 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:21.715854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bc899a53-22dc-4e75-8dfc-9aa82bd9cd74 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:21.716591 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bc899a53-22dc-4e75-8dfc-9aa82bd9cd74 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:21.717073 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bc899a53-22dc-4e75-8dfc-9aa82bd9cd74 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:21.717501 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bc899a53-22dc-4e75-8dfc-9aa82bd9cd74 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:21.929032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-bc899a53-22dc-4e75-8dfc-9aa82bd9cd74 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:21.937342 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-bc899a53-22dc-4e75-8dfc-9aa82bd9cd74 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:21.938782 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-bc899a53-22dc-4e75-8dfc-9aa82bd9cd74 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:21.939874 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-bc899a53-22dc-4e75-8dfc-9aa82bd9cd74 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1406 microversion: 2.20 time: 0.236330 Sep 19 12:35:21.940418 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 409/813] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:21 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:35:22.965174 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-9af15879-e17e-46a1-86e5-3742313e2f7d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:22.965868 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-9af15879-e17e-46a1-86e5-3742313e2f7d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:22.972499 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9af15879-e17e-46a1-86e5-3742313e2f7d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:22.973011 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9af15879-e17e-46a1-86e5-3742313e2f7d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:22.973439 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9af15879-e17e-46a1-86e5-3742313e2f7d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:22.974193 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9af15879-e17e-46a1-86e5-3742313e2f7d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:22.974635 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9af15879-e17e-46a1-86e5-3742313e2f7d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:22.975053 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9af15879-e17e-46a1-86e5-3742313e2f7d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:23.103986 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-9af15879-e17e-46a1-86e5-3742313e2f7d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:23.111912 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-9af15879-e17e-46a1-86e5-3742313e2f7d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:23.113384 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-9af15879-e17e-46a1-86e5-3742313e2f7d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:23.114476 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-9af15879-e17e-46a1-86e5-3742313e2f7d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1406 microversion: 2.20 time: 0.153692 Sep 19 12:35:23.115029 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 405/814] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:22 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:35:24.140768 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-900906da-158e-4ac5-9478-725d1db51a7a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:24.141370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-900906da-158e-4ac5-9478-725d1db51a7a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:24.148185 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-900906da-158e-4ac5-9478-725d1db51a7a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:24.148698 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-900906da-158e-4ac5-9478-725d1db51a7a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:24.149149 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-900906da-158e-4ac5-9478-725d1db51a7a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:24.149873 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-900906da-158e-4ac5-9478-725d1db51a7a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:24.150325 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-900906da-158e-4ac5-9478-725d1db51a7a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:24.150756 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-900906da-158e-4ac5-9478-725d1db51a7a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:24.285057 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-900906da-158e-4ac5-9478-725d1db51a7a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:24.293696 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-900906da-158e-4ac5-9478-725d1db51a7a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:24.295149 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-900906da-158e-4ac5-9478-725d1db51a7a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:24.296303 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-900906da-158e-4ac5-9478-725d1db51a7a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1406 microversion: 2.20 time: 0.159614 Sep 19 12:35:24.296897 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 410/815] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:24 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:35:25.322518 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-2107ab21-f821-47ea-bee4-9617905e11a7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:25.323102 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-2107ab21-f821-47ea-bee4-9617905e11a7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:25.325665 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=6 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:25.330643 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2107ab21-f821-47ea-bee4-9617905e11a7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:25.331152 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2107ab21-f821-47ea-bee4-9617905e11a7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:25.333406 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2107ab21-f821-47ea-bee4-9617905e11a7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:25.333406 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2107ab21-f821-47ea-bee4-9617905e11a7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:25.333406 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2107ab21-f821-47ea-bee4-9617905e11a7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:25.333406 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2107ab21-f821-47ea-bee4-9617905e11a7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:25.469238 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2107ab21-f821-47ea-bee4-9617905e11a7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:25.477797 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2107ab21-f821-47ea-bee4-9617905e11a7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:25.479244 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2107ab21-f821-47ea-bee4-9617905e11a7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:25.480450 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-2107ab21-f821-47ea-bee4-9617905e11a7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1406 microversion: 2.20 time: 0.162455 Sep 19 12:35:25.481138 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 406/816] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:25 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:35:26.505893 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c8e4cc73-a1ee-4454-9840-b1a02c44ffcb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:26.506447 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c8e4cc73-a1ee-4454-9840-b1a02c44ffcb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:26.508316 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=2 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:26.509025 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=6 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:26.514305 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c8e4cc73-a1ee-4454-9840-b1a02c44ffcb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:26.514789 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c8e4cc73-a1ee-4454-9840-b1a02c44ffcb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:26.519031 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c8e4cc73-a1ee-4454-9840-b1a02c44ffcb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:26.519031 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c8e4cc73-a1ee-4454-9840-b1a02c44ffcb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:26.519031 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c8e4cc73-a1ee-4454-9840-b1a02c44ffcb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:26.519031 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c8e4cc73-a1ee-4454-9840-b1a02c44ffcb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:26.652890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c8e4cc73-a1ee-4454-9840-b1a02c44ffcb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:26.661105 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c8e4cc73-a1ee-4454-9840-b1a02c44ffcb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:26.662546 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c8e4cc73-a1ee-4454-9840-b1a02c44ffcb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:26.663694 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c8e4cc73-a1ee-4454-9840-b1a02c44ffcb tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1406 microversion: 2.20 time: 0.162138 Sep 19 12:35:26.664259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 411/817] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:26 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:35:27.689553 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-7999642e-859d-41ba-893f-d6ba3bd5d661 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:27.690158 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-7999642e-859d-41ba-893f-d6ba3bd5d661 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:27.696656 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7999642e-859d-41ba-893f-d6ba3bd5d661 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:27.697142 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7999642e-859d-41ba-893f-d6ba3bd5d661 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:27.697601 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7999642e-859d-41ba-893f-d6ba3bd5d661 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:27.698312 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7999642e-859d-41ba-893f-d6ba3bd5d661 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:27.698765 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7999642e-859d-41ba-893f-d6ba3bd5d661 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:27.699217 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7999642e-859d-41ba-893f-d6ba3bd5d661 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:27.826480 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-7999642e-859d-41ba-893f-d6ba3bd5d661 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:27.834739 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-7999642e-859d-41ba-893f-d6ba3bd5d661 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:27.836267 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-7999642e-859d-41ba-893f-d6ba3bd5d661 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:27.837418 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-7999642e-859d-41ba-893f-d6ba3bd5d661 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1406 microversion: 2.20 time: 0.151808 Sep 19 12:35:27.838039 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 407/818] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:27 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:35:28.862843 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-93bb10be-e995-4da0-b424-f69c012338ae tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:28.863456 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-93bb10be-e995-4da0-b424-f69c012338ae tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:28.870744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-93bb10be-e995-4da0-b424-f69c012338ae tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:28.871233 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-93bb10be-e995-4da0-b424-f69c012338ae tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:28.871664 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-93bb10be-e995-4da0-b424-f69c012338ae tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:28.872435 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-93bb10be-e995-4da0-b424-f69c012338ae tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:28.872861 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-93bb10be-e995-4da0-b424-f69c012338ae tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:28.873283 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-93bb10be-e995-4da0-b424-f69c012338ae tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:29.013143 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-93bb10be-e995-4da0-b424-f69c012338ae tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:29.021740 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-93bb10be-e995-4da0-b424-f69c012338ae tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:29.023220 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-93bb10be-e995-4da0-b424-f69c012338ae tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:29.024345 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-93bb10be-e995-4da0-b424-f69c012338ae tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1406 microversion: 2.20 time: 0.165511 Sep 19 12:35:29.024942 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 412/819] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:28 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:35:29.208343 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8ac3e655-3389-4350-9f42-854ef34cdf03 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:29.208978 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-8ac3e655-3389-4350-9f42-854ef34cdf03 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:29.215408 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8ac3e655-3389-4350-9f42-854ef34cdf03 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:29.215882 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8ac3e655-3389-4350-9f42-854ef34cdf03 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:29.216311 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8ac3e655-3389-4350-9f42-854ef34cdf03 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:29.217023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8ac3e655-3389-4350-9f42-854ef34cdf03 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:29.217468 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8ac3e655-3389-4350-9f42-854ef34cdf03 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:29.217890 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8ac3e655-3389-4350-9f42-854ef34cdf03 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:29.299845 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-8ac3e655-3389-4350-9f42-854ef34cdf03 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lazy-loading 'services' on Instance uuid 9b67a92a-d614-4910-be26-d142a83d03f3 {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:35:29.556488 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8ac3e655-3389-4350-9f42-854ef34cdf03 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3/os-volume_attachments/43143c74-bf92-4d0c-850d-35939aa04c9a" status: 202 len: 0 microversion: 2.1 time: 0.351893 Sep 19 12:35:29.557114 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 408/820] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Sep 19 12:35:29 2022] DELETE /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3/os-volume_attachments/43143c74-bf92-4d0c-850d-35939aa04c9a => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:35:30.050347 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5ac49166-063b-4998-afff-2659ca1f3baf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:30.050898 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-5ac49166-063b-4998-afff-2659ca1f3baf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:30.057551 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5ac49166-063b-4998-afff-2659ca1f3baf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:30.058033 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5ac49166-063b-4998-afff-2659ca1f3baf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:30.058497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5ac49166-063b-4998-afff-2659ca1f3baf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:30.059193 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5ac49166-063b-4998-afff-2659ca1f3baf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:30.059638 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5ac49166-063b-4998-afff-2659ca1f3baf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:30.060087 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5ac49166-063b-4998-afff-2659ca1f3baf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:30.198290 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-5ac49166-063b-4998-afff-2659ca1f3baf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:30.206625 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-5ac49166-063b-4998-afff-2659ca1f3baf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:30.208062 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-5ac49166-063b-4998-afff-2659ca1f3baf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:30.209200 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5ac49166-063b-4998-afff-2659ca1f3baf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1406 microversion: 2.20 time: 0.162993 Sep 19 12:35:30.209752 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 413/821] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:30 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:35:30.341121 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-a6b027ee-d85b-4bb7-861b-caf95589fdce req-893222d7-20f6-4549-abf0-ca720058efd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73260e21-141c-4941-bdbe-66ee0eeef141", "name": "network-vif-plugged", "status": "completed", "tag": "3bbecd75-6878-45e6-92b1-03e016e3daab"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:30.350808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-a6b027ee-d85b-4bb7-861b-caf95589fdce req-893222d7-20f6-4549-abf0-ca720058efd5 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:30.351283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-a6b027ee-d85b-4bb7-861b-caf95589fdce req-893222d7-20f6-4549-abf0-ca720058efd5 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:30.351709 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-a6b027ee-d85b-4bb7-861b-caf95589fdce req-893222d7-20f6-4549-abf0-ca720058efd5 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:30.362627 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-a6b027ee-d85b-4bb7-861b-caf95589fdce req-893222d7-20f6-4549-abf0-ca720058efd5 service nova] Creating event network-vif-plugged:3bbecd75-6878-45e6-92b1-03e016e3daab for instance 73260e21-141c-4941-bdbe-66ee0eeef141 on hv-cinder-85061 Sep 19 12:35:30.367380 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-a6b027ee-d85b-4bb7-861b-caf95589fdce req-893222d7-20f6-4549-abf0-ca720058efd5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030925 Sep 19 12:35:30.367983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 409/822] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:35:30.688634 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2ea5d581-8dbe-44fa-8315-7e5d49cff8ba tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:30.689134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2ea5d581-8dbe-44fa-8315-7e5d49cff8ba tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:30.695704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2ea5d581-8dbe-44fa-8315-7e5d49cff8ba tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:30.696233 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2ea5d581-8dbe-44fa-8315-7e5d49cff8ba tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:30.696530 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2ea5d581-8dbe-44fa-8315-7e5d49cff8ba tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:30.697352 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2ea5d581-8dbe-44fa-8315-7e5d49cff8ba tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:30.697775 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2ea5d581-8dbe-44fa-8315-7e5d49cff8ba tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:30.698197 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2ea5d581-8dbe-44fa-8315-7e5d49cff8ba tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:30.730031 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2ea5d581-8dbe-44fa-8315-7e5d49cff8ba tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Going to try to terminate instance {{(pid=121429) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:35:30.733097 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=100 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:31.089703 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2ea5d581-8dbe-44fa-8315-7e5d49cff8ba tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 204 len: 0 microversion: 2.1 time: 0.404842 Sep 19 12:35:31.090409 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 414/823] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:35:30 2022] DELETE /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:35:31.099265 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-dbd6970c-52be-4221-ae99-ea26cc617bde tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:31.099997 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-dbd6970c-52be-4221-ae99-ea26cc617bde tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:31.106795 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dbd6970c-52be-4221-ae99-ea26cc617bde tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:31.107307 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dbd6970c-52be-4221-ae99-ea26cc617bde tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:31.107767 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dbd6970c-52be-4221-ae99-ea26cc617bde tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:31.108459 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dbd6970c-52be-4221-ae99-ea26cc617bde tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:31.108947 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dbd6970c-52be-4221-ae99-ea26cc617bde tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:31.109372 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-dbd6970c-52be-4221-ae99-ea26cc617bde tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:31.235228 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e23ad4c3-050c-486e-b652-78725b671eea tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:31.236050 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-e23ad4c3-050c-486e-b652-78725b671eea tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:31.242301 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e23ad4c3-050c-486e-b652-78725b671eea tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:31.242780 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e23ad4c3-050c-486e-b652-78725b671eea tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:31.243237 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e23ad4c3-050c-486e-b652-78725b671eea tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:31.243932 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e23ad4c3-050c-486e-b652-78725b671eea tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:31.244388 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e23ad4c3-050c-486e-b652-78725b671eea tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:31.244845 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e23ad4c3-050c-486e-b652-78725b671eea tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:31.245350 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-dbd6970c-52be-4221-ae99-ea26cc617bde tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:31.249964 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:31.253667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-dbd6970c-52be-4221-ae99-ea26cc617bde tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 200 len: 1515 microversion: 2.1 time: 0.158744 Sep 19 12:35:31.254248 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 410/824] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:31 2022] GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:31.374497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e23ad4c3-050c-486e-b652-78725b671eea tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:31.383225 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e23ad4c3-050c-486e-b652-78725b671eea tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:31.385208 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e23ad4c3-050c-486e-b652-78725b671eea tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:31.386310 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e23ad4c3-050c-486e-b652-78725b671eea tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1406 microversion: 2.20 time: 0.155439 Sep 19 12:35:31.386868 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 415/825] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:31 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:35:32.278197 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-66693b6e-e0fe-4b1f-b79b-3197c1c79f23 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:32.278805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-66693b6e-e0fe-4b1f-b79b-3197c1c79f23 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:32.285974 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-66693b6e-e0fe-4b1f-b79b-3197c1c79f23 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:32.286452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-66693b6e-e0fe-4b1f-b79b-3197c1c79f23 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:32.286884 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-66693b6e-e0fe-4b1f-b79b-3197c1c79f23 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:32.287572 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-66693b6e-e0fe-4b1f-b79b-3197c1c79f23 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:32.288018 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-66693b6e-e0fe-4b1f-b79b-3197c1c79f23 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:32.288434 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-66693b6e-e0fe-4b1f-b79b-3197c1c79f23 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:32.411527 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-aac5f01d-a0ee-4d56-8309-2ded7ad4b3f5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:32.412061 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-aac5f01d-a0ee-4d56-8309-2ded7ad4b3f5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:32.414545 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:32.420041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aac5f01d-a0ee-4d56-8309-2ded7ad4b3f5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:32.420533 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aac5f01d-a0ee-4d56-8309-2ded7ad4b3f5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:32.420993 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aac5f01d-a0ee-4d56-8309-2ded7ad4b3f5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:32.421430 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-66693b6e-e0fe-4b1f-b79b-3197c1c79f23 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:32.421695 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aac5f01d-a0ee-4d56-8309-2ded7ad4b3f5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:32.422147 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aac5f01d-a0ee-4d56-8309-2ded7ad4b3f5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:32.422570 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-aac5f01d-a0ee-4d56-8309-2ded7ad4b3f5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:32.430127 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-66693b6e-e0fe-4b1f-b79b-3197c1c79f23 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 200 len: 1515 microversion: 2.1 time: 0.155817 Sep 19 12:35:32.430707 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 411/826] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:32 2022] GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:32.557632 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-aac5f01d-a0ee-4d56-8309-2ded7ad4b3f5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:32.566222 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-aac5f01d-a0ee-4d56-8309-2ded7ad4b3f5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:32.567670 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-aac5f01d-a0ee-4d56-8309-2ded7ad4b3f5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:32.568833 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-aac5f01d-a0ee-4d56-8309-2ded7ad4b3f5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1406 microversion: 2.20 time: 0.161340 Sep 19 12:35:32.569392 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 416/827] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:32 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:35:33.454952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-71be7915-312f-49a1-a2f6-d62726963e1e tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:33.455539 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-71be7915-312f-49a1-a2f6-d62726963e1e tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:33.457524 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:33.462229 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-71be7915-312f-49a1-a2f6-d62726963e1e tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:33.462762 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-71be7915-312f-49a1-a2f6-d62726963e1e tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:33.463146 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-71be7915-312f-49a1-a2f6-d62726963e1e tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:33.466581 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-71be7915-312f-49a1-a2f6-d62726963e1e tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:33.466581 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-71be7915-312f-49a1-a2f6-d62726963e1e tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:33.466581 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-71be7915-312f-49a1-a2f6-d62726963e1e tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:33.594424 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ac7c087d-9264-4cdd-ad6e-e32687491ede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:33.595129 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ac7c087d-9264-4cdd-ad6e-e32687491ede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:33.601649 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-71be7915-312f-49a1-a2f6-d62726963e1e tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:33.603756 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ac7c087d-9264-4cdd-ad6e-e32687491ede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:33.604480 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ac7c087d-9264-4cdd-ad6e-e32687491ede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:33.605151 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ac7c087d-9264-4cdd-ad6e-e32687491ede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:33.605865 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ac7c087d-9264-4cdd-ad6e-e32687491ede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:33.606326 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ac7c087d-9264-4cdd-ad6e-e32687491ede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:33.606754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ac7c087d-9264-4cdd-ad6e-e32687491ede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:33.610291 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-71be7915-312f-49a1-a2f6-d62726963e1e tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 200 len: 1515 microversion: 2.1 time: 0.159836 Sep 19 12:35:33.610900 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 412/828] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:33 2022] GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:33.753139 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ac7c087d-9264-4cdd-ad6e-e32687491ede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:33.762542 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ac7c087d-9264-4cdd-ad6e-e32687491ede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:33.764020 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ac7c087d-9264-4cdd-ad6e-e32687491ede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:33.765174 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ac7c087d-9264-4cdd-ad6e-e32687491ede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1406 microversion: 2.20 time: 0.175228 Sep 19 12:35:33.766144 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 417/829] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:33 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:35:34.312781 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-549c7e82-d072-48c4-91a5-199df122c34b req-e447766b-ce44-46e7-a849-b7a73413df24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b67a92a-d614-4910-be26-d142a83d03f3", "name": "network-vif-deleted", "tag": "eacbc8a6-6f65-49b9-b2d5-21c5309b7686"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:34.323603 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-549c7e82-d072-48c4-91a5-199df122c34b req-e447766b-ce44-46e7-a849-b7a73413df24 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:34.324080 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-549c7e82-d072-48c4-91a5-199df122c34b req-e447766b-ce44-46e7-a849-b7a73413df24 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:34.324510 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-549c7e82-d072-48c4-91a5-199df122c34b req-e447766b-ce44-46e7-a849-b7a73413df24 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:34.336888 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-549c7e82-d072-48c4-91a5-199df122c34b req-e447766b-ce44-46e7-a849-b7a73413df24 service nova] Creating event network-vif-deleted:eacbc8a6-6f65-49b9-b2d5-21c5309b7686 for instance 9b67a92a-d614-4910-be26-d142a83d03f3 on hv-cinder-85061 Sep 19 12:35:34.342164 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-549c7e82-d072-48c4-91a5-199df122c34b req-e447766b-ce44-46e7-a849-b7a73413df24 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033306 Sep 19 12:35:34.342771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 413/830] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:35:34.633586 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ffda5cf7-9856-4865-8871-a72d07b4f72b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:34.634213 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ffda5cf7-9856-4865-8871-a72d07b4f72b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:34.640698 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ffda5cf7-9856-4865-8871-a72d07b4f72b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:34.641152 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ffda5cf7-9856-4865-8871-a72d07b4f72b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:34.641587 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ffda5cf7-9856-4865-8871-a72d07b4f72b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:34.642281 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ffda5cf7-9856-4865-8871-a72d07b4f72b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:34.642800 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ffda5cf7-9856-4865-8871-a72d07b4f72b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:34.643155 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ffda5cf7-9856-4865-8871-a72d07b4f72b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:34.706468 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-ffda5cf7-9856-4865-8871-a72d07b4f72b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:34.715002 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ffda5cf7-9856-4865-8871-a72d07b4f72b tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 200 len: 1304 microversion: 2.1 time: 0.085617 Sep 19 12:35:34.715581 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 418/831] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:34 2022] GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 1304 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:35:34.793047 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-76aad9cc-ef93-4633-9dd0-2b569655d64c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:34.793667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-76aad9cc-ef93-4633-9dd0-2b569655d64c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:34.800280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-76aad9cc-ef93-4633-9dd0-2b569655d64c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:34.800785 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-76aad9cc-ef93-4633-9dd0-2b569655d64c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:34.801214 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-76aad9cc-ef93-4633-9dd0-2b569655d64c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:34.801898 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-76aad9cc-ef93-4633-9dd0-2b569655d64c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:34.802339 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-76aad9cc-ef93-4633-9dd0-2b569655d64c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:34.802752 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-76aad9cc-ef93-4633-9dd0-2b569655d64c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:34.946493 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-76aad9cc-ef93-4633-9dd0-2b569655d64c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:34.955021 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-76aad9cc-ef93-4633-9dd0-2b569655d64c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:34.956537 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-76aad9cc-ef93-4633-9dd0-2b569655d64c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:34.957725 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-76aad9cc-ef93-4633-9dd0-2b569655d64c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1598 microversion: 2.20 time: 0.170147 Sep 19 12:35:34.958290 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 414/832] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:35:34 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:35:34.983558 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-7dc8b1ce-43f9-4594-93c9-935d254f0d84 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:34.984059 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-7dc8b1ce-43f9-4594-93c9-935d254f0d84 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:34.990347 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7dc8b1ce-43f9-4594-93c9-935d254f0d84 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:34.990833 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7dc8b1ce-43f9-4594-93c9-935d254f0d84 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:34.991267 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7dc8b1ce-43f9-4594-93c9-935d254f0d84 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:34.991992 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7dc8b1ce-43f9-4594-93c9-935d254f0d84 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:34.992495 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7dc8b1ce-43f9-4594-93c9-935d254f0d84 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:34.992968 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7dc8b1ce-43f9-4594-93c9-935d254f0d84 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:35.069224 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-7dc8b1ce-43f9-4594-93c9-935d254f0d84 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090507 Sep 19 12:35:35.069850 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 419/833] 10.222.0.93 () {60 vars in 1316 bytes} [Mon Sep 19 12:35:34 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:35:35.739116 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8c3372ba-9816-46ab-b4df-b9ab354c5f6c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:35.739551 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-8c3372ba-9816-46ab-b4df-b9ab354c5f6c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 9b67a92a-d614-4910-be26-d142a83d03f3] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:35.747312 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8c3372ba-9816-46ab-b4df-b9ab354c5f6c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:35.747312 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8c3372ba-9816-46ab-b4df-b9ab354c5f6c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:35.747606 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8c3372ba-9816-46ab-b4df-b9ab354c5f6c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:35.748333 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8c3372ba-9816-46ab-b4df-b9ab354c5f6c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:35.748812 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8c3372ba-9816-46ab-b4df-b9ab354c5f6c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:35.749412 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8c3372ba-9816-46ab-b4df-b9ab354c5f6c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:35.763013 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-8c3372ba-9816-46ab-b4df-b9ab354c5f6c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] HTTP exception thrown: Instance 9b67a92a-d614-4910-be26-d142a83d03f3 could not be found. Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8c3372ba-9816-46ab-b4df-b9ab354c5f6c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Request method failure captured: Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 HTTP/1.1 Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKGHUoHfDs-zPE4-A_uoeMLVAIOSY2FyxfdEuPOP_X-ChDrOIoyoYV_gdBgqdrUpAidDO5jY0nMv545bmaLIlCEHmokNceZwQM5w4G3CCt2kvAjbF9EL5VmMJxzhv5OcWTaT6RFkXOK9Y321Es1qLd3iN0OAcx1d-8SH6ByXwOOJgNGg Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 6d9c692267e643c5b0e2b8ee8cdc85fe Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-VolumesSnapshotTestJSON-915750527 Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:35:35.764682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:35:35.766447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6d9c692267e643c5b0e2b8ee8cdc85fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6d9c692267e643c5b0e2b8ee8cdc85fe", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6d9c692267e643c5b0e2b8ee8cdc85fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6d9c692267e643c5b0e2b8ee8cdc85fe"}]}] Sep 19 12:35:35.766447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-VolumesSnapshotTestJSON-915750527 Sep 19 12:35:35.766447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 6d9c692267e643c5b0e2b8ee8cdc85fe Sep 19 12:35:35.766447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-915750527 Sep 19 12:35:35.766447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-VolumesSnapshotTestJSON-915750527-project Sep 19 12:35:35.766447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:35:35.766447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:35:35.766447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: 766abab8ce04417b83175b7a4a8d5f0f Sep 19 12:35:35.766447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-VolumesSnapshotTestJSON-915750527-project Sep 19 12:35:35.766447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:35:35.766447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance 9b67a92a-d614-4910-be26-d142a83d03f3 could not be found. Sep 19 12:35:35.766447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': '9b67a92a-d614-4910-be26-d142a83d03f3'} Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b67a92a-d614-4910-be26-d142a83d03f3 could not be found. Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:35:35.767328 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:35:35.768579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:35:35.768579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:35:35.768579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:35:35.768579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:35:35.768579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:35:35.768579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:35:35.768579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:35:35.768579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b67a92a-d614-4910-be26-d142a83d03f3 could not be found. Sep 19 12:35:35.768579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:35:35.768579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:35:35.768579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:35:35.768579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:35:35.768579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:35:35.768579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:35:35.768579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:35:35.768579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:35:35.768579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b67a92a-d614-4910-be26-d142a83d03f3 could not be found. Sep 19 12:35:35.768579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:35:35.771504 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8c3372ba-9816-46ab-b4df-b9ab354c5f6c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Returning 404 to user: Instance 9b67a92a-d614-4910-be26-d142a83d03f3 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:35:35.771504 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8c3372ba-9816-46ab-b4df-b9ab354c5f6c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3" status: 404 len: 111 microversion: 2.1 time: 0.031244 Sep 19 12:35:35.771504 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 415/834] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:35 2022] GET /compute/v2.1/servers/9b67a92a-d614-4910-be26-d142a83d03f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:35:36.358116 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-390cdd4b-e440-4e95-9281-3750de266d79 req-69a1c389-84f4-47f7-ad73-7a314e681935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73260e21-141c-4941-bdbe-66ee0eeef141", "tag": "3bbecd75-6878-45e6-92b1-03e016e3daab"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:36.367482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-390cdd4b-e440-4e95-9281-3750de266d79 req-69a1c389-84f4-47f7-ad73-7a314e681935 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:36.367959 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-390cdd4b-e440-4e95-9281-3750de266d79 req-69a1c389-84f4-47f7-ad73-7a314e681935 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:36.368391 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-390cdd4b-e440-4e95-9281-3750de266d79 req-69a1c389-84f4-47f7-ad73-7a314e681935 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:36.379913 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-390cdd4b-e440-4e95-9281-3750de266d79 req-69a1c389-84f4-47f7-ad73-7a314e681935 service nova] Creating event network-changed:3bbecd75-6878-45e6-92b1-03e016e3daab for instance 73260e21-141c-4941-bdbe-66ee0eeef141 on hv-cinder-85061 Sep 19 12:35:36.385666 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-390cdd4b-e440-4e95-9281-3750de266d79 req-69a1c389-84f4-47f7-ad73-7a314e681935 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031201 Sep 19 12:35:36.386317 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 420/835] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:35:46.209166 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-5e5797a5-72ab-4710-a169-0e99bdbdafed tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-334093932", "imageRef": "d4301833-8e96-46bf-a940-692f93f7fdba", "flavorRef": "452", "networks": [{"uuid": "da226559-99ea-41b1-8942-bdd453f99fd3"}]}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:46.217843 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=7 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:46.218497 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=22 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:46.264695 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.network.neutron [None req-5e5797a5-72ab-4710-a169-0e99bdbdafed tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] validate_networks() for [('da226559-99ea-41b1-8942-bdd453f99fd3', None, None, None, None, None)] {{(pid=121428) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:35:46.613533 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-5e5797a5-72ab-4710-a169-0e99bdbdafed tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Flavor limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:35:46.613946 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-5e5797a5-72ab-4710-a169-0e99bdbdafed tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Image limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:35:46.614411 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-5e5797a5-72ab-4710-a169-0e99bdbdafed tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Flavor pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:35:46.614813 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-5e5797a5-72ab-4710-a169-0e99bdbdafed tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Image pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:35:46.615215 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-5e5797a5-72ab-4710-a169-0e99bdbdafed tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:35:46.624707 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5e5797a5-72ab-4710-a169-0e99bdbdafed tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:46.625121 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5e5797a5-72ab-4710-a169-0e99bdbdafed tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:46.625550 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5e5797a5-72ab-4710-a169-0e99bdbdafed tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:46.626261 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5e5797a5-72ab-4710-a169-0e99bdbdafed tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:46.626748 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5e5797a5-72ab-4710-a169-0e99bdbdafed tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:46.627164 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5e5797a5-72ab-4710-a169-0e99bdbdafed tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:46.644498 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-5e5797a5-72ab-4710-a169-0e99bdbdafed tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Getting quotas for project 6d9c692267e643c5b0e2b8ee8cdc85fe. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:35:46.649297 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-5e5797a5-72ab-4710-a169-0e99bdbdafed tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Getting quotas for user 766abab8ce04417b83175b7a4a8d5f0f and project 6d9c692267e643c5b0e2b8ee8cdc85fe. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:35:46.660951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-5e5797a5-72ab-4710-a169-0e99bdbdafed tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Going to run 1 instances... {{(pid=121428) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:35:46.663368 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-5e5797a5-72ab-4710-a169-0e99bdbdafed tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4301833-8e96-46bf-a940-692f93f7fdba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:35:46.786818 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-5e5797a5-72ab-4710-a169-0e99bdbdafed tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581533 Sep 19 12:35:46.787459 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 416/836] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:35:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:35:46.797559 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=9 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:46.798603 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:46.802793 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-1e5e27d2-25ca-4f37-8c69-2e90f90ecffe tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:46.803514 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-1e5e27d2-25ca-4f37-8c69-2e90f90ecffe tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:46.857640 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-1e5e27d2-25ca-4f37-8c69-2e90f90ecffe tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:46.865166 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-1e5e27d2-25ca-4f37-8c69-2e90f90ecffe tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb" status: 200 len: 1218 microversion: 2.1 time: 0.069443 Sep 19 12:35:46.865744 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 421/837] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:46 2022] GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:47.889001 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f53c2ae1-bce0-4e63-abc5-a17c7443ed44 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:47.889592 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f53c2ae1-bce0-4e63-abc5-a17c7443ed44 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:47.896326 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f53c2ae1-bce0-4e63-abc5-a17c7443ed44 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:47.896837 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f53c2ae1-bce0-4e63-abc5-a17c7443ed44 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:47.897274 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f53c2ae1-bce0-4e63-abc5-a17c7443ed44 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:47.897966 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f53c2ae1-bce0-4e63-abc5-a17c7443ed44 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:47.898417 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f53c2ae1-bce0-4e63-abc5-a17c7443ed44 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:47.898840 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f53c2ae1-bce0-4e63-abc5-a17c7443ed44 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:47.963658 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f53c2ae1-bce0-4e63-abc5-a17c7443ed44 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:47.971601 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f53c2ae1-bce0-4e63-abc5-a17c7443ed44 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb" status: 200 len: 1222 microversion: 2.1 time: 0.086911 Sep 19 12:35:47.972173 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 417/838] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:47 2022] GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:49.000089 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-590227f7-c721-46e4-9b3a-1a868094bed9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:49.000089 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-590227f7-c721-46e4-9b3a-1a868094bed9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:49.004200 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-590227f7-c721-46e4-9b3a-1a868094bed9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:49.004727 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-590227f7-c721-46e4-9b3a-1a868094bed9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:49.005524 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-590227f7-c721-46e4-9b3a-1a868094bed9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:49.006483 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-590227f7-c721-46e4-9b3a-1a868094bed9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:49.007169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-590227f7-c721-46e4-9b3a-1a868094bed9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:49.007782 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-590227f7-c721-46e4-9b3a-1a868094bed9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:49.116703 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-590227f7-c721-46e4-9b3a-1a868094bed9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:49.126461 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-590227f7-c721-46e4-9b3a-1a868094bed9 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb" status: 200 len: 1278 microversion: 2.1 time: 0.134771 Sep 19 12:35:49.127409 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 422/839] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:48 2022] GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb => generated 1278 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:50.152229 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-37f9fef3-bb81-44e0-a86c-69a28af418b5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:50.153297 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-37f9fef3-bb81-44e0-a86c-69a28af418b5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:50.159689 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-37f9fef3-bb81-44e0-a86c-69a28af418b5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:50.160168 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-37f9fef3-bb81-44e0-a86c-69a28af418b5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:50.160617 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-37f9fef3-bb81-44e0-a86c-69a28af418b5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:50.161319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-37f9fef3-bb81-44e0-a86c-69a28af418b5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:50.161766 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-37f9fef3-bb81-44e0-a86c-69a28af418b5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:50.162187 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-37f9fef3-bb81-44e0-a86c-69a28af418b5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:50.363841 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-37f9fef3-bb81-44e0-a86c-69a28af418b5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:50.372186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-37f9fef3-bb81-44e0-a86c-69a28af418b5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb" status: 200 len: 1318 microversion: 2.1 time: 0.224653 Sep 19 12:35:50.372811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 418/840] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:50 2022] GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:50.962669 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-7915145e-d1f5-4a86-93a2-24fff088dfba req-20094c0e-7a1e-4729-b4f1-a75a255a87ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "453aad65-dbd1-4959-b4de-68db25577cfb", "tag": "964a46de-67a8-4ee7-b16c-24c0f4a8bf28"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:50.979215 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-7915145e-d1f5-4a86-93a2-24fff088dfba req-20094c0e-7a1e-4729-b4f1-a75a255a87ff service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:50.979709 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-7915145e-d1f5-4a86-93a2-24fff088dfba req-20094c0e-7a1e-4729-b4f1-a75a255a87ff service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:50.980148 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-7915145e-d1f5-4a86-93a2-24fff088dfba req-20094c0e-7a1e-4729-b4f1-a75a255a87ff service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:50.992415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-7915145e-d1f5-4a86-93a2-24fff088dfba req-20094c0e-7a1e-4729-b4f1-a75a255a87ff service nova] Creating event network-changed:964a46de-67a8-4ee7-b16c-24c0f4a8bf28 for instance 453aad65-dbd1-4959-b4de-68db25577cfb on hv-cinder-85061 Sep 19 12:35:50.998611 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-7915145e-d1f5-4a86-93a2-24fff088dfba req-20094c0e-7a1e-4729-b4f1-a75a255a87ff service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039897 Sep 19 12:35:51.006835 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 423/841] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:35:51.395559 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f9c3a1e1-8304-413a-b36a-61679abb6d65 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:51.396162 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f9c3a1e1-8304-413a-b36a-61679abb6d65 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:51.403250 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f9c3a1e1-8304-413a-b36a-61679abb6d65 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:51.403726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f9c3a1e1-8304-413a-b36a-61679abb6d65 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:51.404153 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f9c3a1e1-8304-413a-b36a-61679abb6d65 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:51.404870 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f9c3a1e1-8304-413a-b36a-61679abb6d65 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:51.405313 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f9c3a1e1-8304-413a-b36a-61679abb6d65 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:51.405725 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f9c3a1e1-8304-413a-b36a-61679abb6d65 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:51.634651 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f9c3a1e1-8304-413a-b36a-61679abb6d65 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:51.642967 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f9c3a1e1-8304-413a-b36a-61679abb6d65 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb" status: 200 len: 1318 microversion: 2.1 time: 0.251482 Sep 19 12:35:51.643544 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 419/842] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:51 2022] GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:52.667949 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b39eb2ed-0548-4c47-a9fb-497294c47cbb tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:52.668682 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b39eb2ed-0548-4c47-a9fb-497294c47cbb tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:52.675174 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b39eb2ed-0548-4c47-a9fb-497294c47cbb tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:52.675662 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b39eb2ed-0548-4c47-a9fb-497294c47cbb tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:52.676097 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b39eb2ed-0548-4c47-a9fb-497294c47cbb tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:52.676827 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b39eb2ed-0548-4c47-a9fb-497294c47cbb tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:52.677275 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b39eb2ed-0548-4c47-a9fb-497294c47cbb tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:52.677700 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b39eb2ed-0548-4c47-a9fb-497294c47cbb tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:52.804469 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-b39eb2ed-0548-4c47-a9fb-497294c47cbb tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:52.812298 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-b39eb2ed-0548-4c47-a9fb-497294c47cbb tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb" status: 200 len: 1318 microversion: 2.1 time: 0.149929 Sep 19 12:35:52.812908 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 424/843] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:52 2022] GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:53.835434 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-811c2797-a02f-427d-b7b3-332a71dc1403 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:53.836021 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-811c2797-a02f-427d-b7b3-332a71dc1403 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:53.842465 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-811c2797-a02f-427d-b7b3-332a71dc1403 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:53.842932 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-811c2797-a02f-427d-b7b3-332a71dc1403 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:53.843360 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-811c2797-a02f-427d-b7b3-332a71dc1403 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:53.844065 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-811c2797-a02f-427d-b7b3-332a71dc1403 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:53.844483 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-811c2797-a02f-427d-b7b3-332a71dc1403 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:53.844919 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-811c2797-a02f-427d-b7b3-332a71dc1403 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:53.977350 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-811c2797-a02f-427d-b7b3-332a71dc1403 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:53.986340 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-811c2797-a02f-427d-b7b3-332a71dc1403 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb" status: 200 len: 1318 microversion: 2.1 time: 0.154674 Sep 19 12:35:53.986949 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 420/844] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:53 2022] GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:55.011157 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-7a772057-f991-4c0c-87c9-775933b39a89 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:55.011823 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-7a772057-f991-4c0c-87c9-775933b39a89 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:55.018307 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7a772057-f991-4c0c-87c9-775933b39a89 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:55.018892 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7a772057-f991-4c0c-87c9-775933b39a89 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:55.019220 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7a772057-f991-4c0c-87c9-775933b39a89 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:55.019912 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7a772057-f991-4c0c-87c9-775933b39a89 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:55.020363 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7a772057-f991-4c0c-87c9-775933b39a89 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:55.020830 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7a772057-f991-4c0c-87c9-775933b39a89 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:55.156154 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-7a772057-f991-4c0c-87c9-775933b39a89 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:55.164122 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-7a772057-f991-4c0c-87c9-775933b39a89 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb" status: 200 len: 1318 microversion: 2.1 time: 0.157366 Sep 19 12:35:55.164823 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 425/845] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:55 2022] GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:56.188212 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c47c91c7-21d5-4760-864a-dd73ab9c7259 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:56.188844 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c47c91c7-21d5-4760-864a-dd73ab9c7259 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:56.198811 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c47c91c7-21d5-4760-864a-dd73ab9c7259 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:56.199380 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c47c91c7-21d5-4760-864a-dd73ab9c7259 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:56.200035 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c47c91c7-21d5-4760-864a-dd73ab9c7259 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:56.200849 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c47c91c7-21d5-4760-864a-dd73ab9c7259 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:56.204625 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c47c91c7-21d5-4760-864a-dd73ab9c7259 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:56.204625 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c47c91c7-21d5-4760-864a-dd73ab9c7259 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:56.336160 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c47c91c7-21d5-4760-864a-dd73ab9c7259 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:56.344832 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c47c91c7-21d5-4760-864a-dd73ab9c7259 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb" status: 200 len: 1318 microversion: 2.1 time: 0.160625 Sep 19 12:35:56.345497 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 421/846] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:56 2022] GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:56.425936 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-29ffd5bf-4889-4ff4-b460-34fc35ee1456 req-7d4d5974-87b7-457b-87c5-d2ba25b86ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "453aad65-dbd1-4959-b4de-68db25577cfb", "name": "network-vif-plugged", "status": "completed", "tag": "964a46de-67a8-4ee7-b16c-24c0f4a8bf28"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:56.436611 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-29ffd5bf-4889-4ff4-b460-34fc35ee1456 req-7d4d5974-87b7-457b-87c5-d2ba25b86ec8 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:56.437289 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-29ffd5bf-4889-4ff4-b460-34fc35ee1456 req-7d4d5974-87b7-457b-87c5-d2ba25b86ec8 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:56.437570 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-29ffd5bf-4889-4ff4-b460-34fc35ee1456 req-7d4d5974-87b7-457b-87c5-d2ba25b86ec8 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:56.448943 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-29ffd5bf-4889-4ff4-b460-34fc35ee1456 req-7d4d5974-87b7-457b-87c5-d2ba25b86ec8 service nova] Creating event network-vif-plugged:964a46de-67a8-4ee7-b16c-24c0f4a8bf28 for instance 453aad65-dbd1-4959-b4de-68db25577cfb on hv-cinder-85061 Sep 19 12:35:56.454045 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-29ffd5bf-4889-4ff4-b460-34fc35ee1456 req-7d4d5974-87b7-457b-87c5-d2ba25b86ec8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031852 Sep 19 12:35:56.462443 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 426/847] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:35:57.369095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-62a4ce95-f84b-4aaa-86c6-7a9035ef7df5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:57.369703 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-62a4ce95-f84b-4aaa-86c6-7a9035ef7df5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:57.371678 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=2 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:57.372330 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=6 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:57.377618 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-62a4ce95-f84b-4aaa-86c6-7a9035ef7df5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:57.379178 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-62a4ce95-f84b-4aaa-86c6-7a9035ef7df5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:57.379178 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-62a4ce95-f84b-4aaa-86c6-7a9035ef7df5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:57.379453 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-62a4ce95-f84b-4aaa-86c6-7a9035ef7df5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:57.380102 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-62a4ce95-f84b-4aaa-86c6-7a9035ef7df5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:57.380519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-62a4ce95-f84b-4aaa-86c6-7a9035ef7df5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:57.517616 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-62a4ce95-f84b-4aaa-86c6-7a9035ef7df5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:57.526124 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-62a4ce95-f84b-4aaa-86c6-7a9035ef7df5 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb" status: 200 len: 1318 microversion: 2.1 time: 0.160417 Sep 19 12:35:57.526694 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 422/848] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:57 2022] GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:58.546284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=2 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:58.550899 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-acef7af5-ab2e-4c66-88bf-952199fa6ec8 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:58.551609 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-acef7af5-ab2e-4c66-88bf-952199fa6ec8 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:58.558353 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-acef7af5-ab2e-4c66-88bf-952199fa6ec8 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:58.558839 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-acef7af5-ab2e-4c66-88bf-952199fa6ec8 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:58.559277 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-acef7af5-ab2e-4c66-88bf-952199fa6ec8 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:58.559979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-acef7af5-ab2e-4c66-88bf-952199fa6ec8 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:58.560424 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-acef7af5-ab2e-4c66-88bf-952199fa6ec8 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:58.560877 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-acef7af5-ab2e-4c66-88bf-952199fa6ec8 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:58.696379 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-acef7af5-ab2e-4c66-88bf-952199fa6ec8 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:58.704511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-acef7af5-ab2e-4c66-88bf-952199fa6ec8 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb" status: 200 len: 1507 microversion: 2.1 time: 0.159124 Sep 19 12:35:58.705141 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 427/849] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:58 2022] GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:58.728072 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e4a2fcc5-e37b-42a1-85f3-450d3452def7 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90e960b1-d1dc-40fb-b169-faa2a06298d1", "device": "/dev/sdb"}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:58.731143 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e4a2fcc5-e37b-42a1-85f3-450d3452def7 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:58.737775 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e4a2fcc5-e37b-42a1-85f3-450d3452def7 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:58.738266 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e4a2fcc5-e37b-42a1-85f3-450d3452def7 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:58.738700 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e4a2fcc5-e37b-42a1-85f3-450d3452def7 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:58.739402 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e4a2fcc5-e37b-42a1-85f3-450d3452def7 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:58.739859 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e4a2fcc5-e37b-42a1-85f3-450d3452def7 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:58.740763 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e4a2fcc5-e37b-42a1-85f3-450d3452def7 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:59.578640 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e4a2fcc5-e37b-42a1-85f3-450d3452def7 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "POST /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.854419 Sep 19 12:35:59.579264 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 423/850] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Sep 19 12:35:58 2022] POST /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb/os-volume_attachments => generated 194 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:36:19.894293 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-803c7d24-7f21-4716-b1ca-ce769548f285 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:19.894911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-803c7d24-7f21-4716-b1ca-ce769548f285 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:19.897165 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=16 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:36:19.897874 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=28 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:36:19.903544 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-803c7d24-7f21-4716-b1ca-ce769548f285 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:19.909420 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-803c7d24-7f21-4716-b1ca-ce769548f285 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:19.909420 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-803c7d24-7f21-4716-b1ca-ce769548f285 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:19.909420 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-803c7d24-7f21-4716-b1ca-ce769548f285 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:19.909420 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-803c7d24-7f21-4716-b1ca-ce769548f285 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:19.909910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-803c7d24-7f21-4716-b1ca-ce769548f285 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:20.076070 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b55f8892-00ab-4936-b8b3-38f13a747530 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:20.076712 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-b55f8892-00ab-4936-b8b3-38f13a747530 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:20.079269 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:36:20.079999 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:36:20.085046 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b55f8892-00ab-4936-b8b3-38f13a747530 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:20.089946 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b55f8892-00ab-4936-b8b3-38f13a747530 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:20.089946 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b55f8892-00ab-4936-b8b3-38f13a747530 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:20.089946 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b55f8892-00ab-4936-b8b3-38f13a747530 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:20.089946 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b55f8892-00ab-4936-b8b3-38f13a747530 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:20.090343 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b55f8892-00ab-4936-b8b3-38f13a747530 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:20.116063 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-b55f8892-00ab-4936-b8b3-38f13a747530 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141/ips" status: 200 len: 151 microversion: 2.20 time: 0.044277 Sep 19 12:36:20.118746 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 424/851] 10.222.0.93 () {60 vars in 1289 bytes} [Mon Sep 19 12:36:20 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:36:20.188091 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.objects.instance [None req-803c7d24-7f21-4716-b1ca-ce769548f285 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lazy-loading 'services' on Instance uuid 453aad65-dbd1-4959-b4de-68db25577cfb {{(pid=121429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:36:20.460155 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-803c7d24-7f21-4716-b1ca-ce769548f285 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "DELETE /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb/os-volume_attachments/90e960b1-d1dc-40fb-b169-faa2a06298d1" status: 202 len: 0 microversion: 2.1 time: 0.569778 Sep 19 12:36:20.460804 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 428/852] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Sep 19 12:36:19 2022] DELETE /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb/os-volume_attachments/90e960b1-d1dc-40fb-b169-faa2a06298d1 => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:36:21.599082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-67a39630-dc3d-4ef7-8023-3125ae3e4765 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:21.599817 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-67a39630-dc3d-4ef7-8023-3125ae3e4765 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:21.608402 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-67a39630-dc3d-4ef7-8023-3125ae3e4765 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:21.613059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-67a39630-dc3d-4ef7-8023-3125ae3e4765 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:21.613059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-67a39630-dc3d-4ef7-8023-3125ae3e4765 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:21.613059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-67a39630-dc3d-4ef7-8023-3125ae3e4765 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:21.613059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-67a39630-dc3d-4ef7-8023-3125ae3e4765 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:21.613760 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-67a39630-dc3d-4ef7-8023-3125ae3e4765 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:21.639142 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-67a39630-dc3d-4ef7-8023-3125ae3e4765 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Going to try to terminate instance {{(pid=121428) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:36:22.133610 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-67a39630-dc3d-4ef7-8023-3125ae3e4765 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "DELETE /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb" status: 204 len: 0 microversion: 2.1 time: 0.538647 Sep 19 12:36:22.134755 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 425/853] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:36:21 2022] DELETE /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:36:22.145029 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5a3d151f-0ccb-4a71-85d0-8cae5be33c14 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:22.145722 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-5a3d151f-0ccb-4a71-85d0-8cae5be33c14 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:22.152487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5a3d151f-0ccb-4a71-85d0-8cae5be33c14 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:22.153009 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5a3d151f-0ccb-4a71-85d0-8cae5be33c14 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:22.153471 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5a3d151f-0ccb-4a71-85d0-8cae5be33c14 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:22.154160 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5a3d151f-0ccb-4a71-85d0-8cae5be33c14 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:22.154607 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5a3d151f-0ccb-4a71-85d0-8cae5be33c14 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:22.155151 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5a3d151f-0ccb-4a71-85d0-8cae5be33c14 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:22.297916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-5a3d151f-0ccb-4a71-85d0-8cae5be33c14 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:22.306233 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5a3d151f-0ccb-4a71-85d0-8cae5be33c14 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb" status: 200 len: 1513 microversion: 2.1 time: 0.166328 Sep 19 12:36:22.306799 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 429/854] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:22 2022] GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:36:22.337003 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-1347fe8d-f121-4a65-b663-4409cc00ae47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:36:22.337662 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-1347fe8d-f121-4a65-b663-4409cc00ae47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:22.343670 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1347fe8d-f121-4a65-b663-4409cc00ae47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:22.344156 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1347fe8d-f121-4a65-b663-4409cc00ae47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:22.344669 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1347fe8d-f121-4a65-b663-4409cc00ae47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:22.345363 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1347fe8d-f121-4a65-b663-4409cc00ae47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:22.345821 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1347fe8d-f121-4a65-b663-4409cc00ae47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:22.346244 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1347fe8d-f121-4a65-b663-4409cc00ae47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:22.369438 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-1347fe8d-f121-4a65-b663-4409cc00ae47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lazy-loading 'flavor' on Instance uuid 73260e21-141c-4941-bdbe-66ee0eeef141 {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:36:22.927352 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-1347fe8d-f121-4a65-b663-4409cc00ae47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "POST /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141/action" status: 202 len: 0 microversion: 2.20 time: 0.594620 Sep 19 12:36:22.927945 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 426/855] 10.222.0.93 () {62 vars in 1319 bytes} [Mon Sep 19 12:36:22 2022] POST /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141/action => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:36:22.936234 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-fa19e4ff-2f73-4aab-804e-56e7e6f0fe01 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:22.937050 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-fa19e4ff-2f73-4aab-804e-56e7e6f0fe01 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:22.943065 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fa19e4ff-2f73-4aab-804e-56e7e6f0fe01 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:22.943532 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fa19e4ff-2f73-4aab-804e-56e7e6f0fe01 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:22.943958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fa19e4ff-2f73-4aab-804e-56e7e6f0fe01 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:22.944671 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fa19e4ff-2f73-4aab-804e-56e7e6f0fe01 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:22.945112 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fa19e4ff-2f73-4aab-804e-56e7e6f0fe01 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:22.945528 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fa19e4ff-2f73-4aab-804e-56e7e6f0fe01 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:23.077317 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-fa19e4ff-2f73-4aab-804e-56e7e6f0fe01 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:23.085294 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-fa19e4ff-2f73-4aab-804e-56e7e6f0fe01 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:23.086752 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-fa19e4ff-2f73-4aab-804e-56e7e6f0fe01 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:23.088403 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-fa19e4ff-2f73-4aab-804e-56e7e6f0fe01 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1722 microversion: 2.20 time: 0.156098 Sep 19 12:36:23.089002 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 430/856] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:22 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:23.331774 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-41f1da5b-9bb4-40c5-a07d-5bc2761a2655 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:23.332487 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-41f1da5b-9bb4-40c5-a07d-5bc2761a2655 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:23.340438 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-41f1da5b-9bb4-40c5-a07d-5bc2761a2655 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:23.340940 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-41f1da5b-9bb4-40c5-a07d-5bc2761a2655 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:23.341405 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-41f1da5b-9bb4-40c5-a07d-5bc2761a2655 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:23.342101 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-41f1da5b-9bb4-40c5-a07d-5bc2761a2655 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:23.342553 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-41f1da5b-9bb4-40c5-a07d-5bc2761a2655 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:23.342997 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-41f1da5b-9bb4-40c5-a07d-5bc2761a2655 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:23.481901 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-41f1da5b-9bb4-40c5-a07d-5bc2761a2655 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:23.490479 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-41f1da5b-9bb4-40c5-a07d-5bc2761a2655 tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb" status: 200 len: 1513 microversion: 2.1 time: 0.162842 Sep 19 12:36:23.491073 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 427/857] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:23 2022] GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:36:24.114562 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-78c64844-170f-44f6-969b-3a7ca8a86c05 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:24.115176 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-78c64844-170f-44f6-969b-3a7ca8a86c05 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:24.122513 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-78c64844-170f-44f6-969b-3a7ca8a86c05 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:24.122997 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-78c64844-170f-44f6-969b-3a7ca8a86c05 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:24.123428 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-78c64844-170f-44f6-969b-3a7ca8a86c05 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:24.124129 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-78c64844-170f-44f6-969b-3a7ca8a86c05 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:24.124577 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-78c64844-170f-44f6-969b-3a7ca8a86c05 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:24.125030 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-78c64844-170f-44f6-969b-3a7ca8a86c05 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:24.353472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-78c64844-170f-44f6-969b-3a7ca8a86c05 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:24.362348 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-78c64844-170f-44f6-969b-3a7ca8a86c05 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:24.363820 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-78c64844-170f-44f6-969b-3a7ca8a86c05 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:24.365211 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-78c64844-170f-44f6-969b-3a7ca8a86c05 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1722 microversion: 2.20 time: 0.254544 Sep 19 12:36:24.365787 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 431/858] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:24 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:24.514175 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-15776b83-12f1-48fe-bdf6-7cc0ba32b02c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:24.514795 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-15776b83-12f1-48fe-bdf6-7cc0ba32b02c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:24.521519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-15776b83-12f1-48fe-bdf6-7cc0ba32b02c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:24.522008 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-15776b83-12f1-48fe-bdf6-7cc0ba32b02c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:24.522452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-15776b83-12f1-48fe-bdf6-7cc0ba32b02c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:24.523161 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-15776b83-12f1-48fe-bdf6-7cc0ba32b02c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:24.523608 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-15776b83-12f1-48fe-bdf6-7cc0ba32b02c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:24.524037 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-15776b83-12f1-48fe-bdf6-7cc0ba32b02c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:24.728760 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-15776b83-12f1-48fe-bdf6-7cc0ba32b02c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:24.736702 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-15776b83-12f1-48fe-bdf6-7cc0ba32b02c tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb" status: 200 len: 1513 microversion: 2.1 time: 0.226350 Sep 19 12:36:24.737173 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 428/859] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:24 2022] GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:36:24.756999 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-008b8ff3-61bb-4b28-8fce-19addbc6d124 req-241c75b4-2fc2-48d9-80d8-d9b59fc04ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "453aad65-dbd1-4959-b4de-68db25577cfb", "name": "network-vif-deleted", "tag": "964a46de-67a8-4ee7-b16c-24c0f4a8bf28"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:36:24.767206 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-008b8ff3-61bb-4b28-8fce-19addbc6d124 req-241c75b4-2fc2-48d9-80d8-d9b59fc04ff0 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:24.767693 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-008b8ff3-61bb-4b28-8fce-19addbc6d124 req-241c75b4-2fc2-48d9-80d8-d9b59fc04ff0 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:24.768133 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-008b8ff3-61bb-4b28-8fce-19addbc6d124 req-241c75b4-2fc2-48d9-80d8-d9b59fc04ff0 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:24.780053 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-008b8ff3-61bb-4b28-8fce-19addbc6d124 req-241c75b4-2fc2-48d9-80d8-d9b59fc04ff0 service nova] Creating event network-vif-deleted:964a46de-67a8-4ee7-b16c-24c0f4a8bf28 for instance 453aad65-dbd1-4959-b4de-68db25577cfb on hv-cinder-85061 Sep 19 12:36:24.784876 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-008b8ff3-61bb-4b28-8fce-19addbc6d124 req-241c75b4-2fc2-48d9-80d8-d9b59fc04ff0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032057 Sep 19 12:36:24.785475 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 432/860] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:36:25.390670 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-aa5a2777-fbf9-4819-a2e7-7f3bb3f1b0b7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:25.391283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-aa5a2777-fbf9-4819-a2e7-7f3bb3f1b0b7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:25.397245 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-aa5a2777-fbf9-4819-a2e7-7f3bb3f1b0b7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:25.397730 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-aa5a2777-fbf9-4819-a2e7-7f3bb3f1b0b7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:25.398163 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-aa5a2777-fbf9-4819-a2e7-7f3bb3f1b0b7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:25.398862 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-aa5a2777-fbf9-4819-a2e7-7f3bb3f1b0b7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:25.399313 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-aa5a2777-fbf9-4819-a2e7-7f3bb3f1b0b7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:25.399736 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-aa5a2777-fbf9-4819-a2e7-7f3bb3f1b0b7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:25.536454 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-aa5a2777-fbf9-4819-a2e7-7f3bb3f1b0b7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:25.545589 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-aa5a2777-fbf9-4819-a2e7-7f3bb3f1b0b7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:25.546914 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-aa5a2777-fbf9-4819-a2e7-7f3bb3f1b0b7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:25.548078 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-aa5a2777-fbf9-4819-a2e7-7f3bb3f1b0b7 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1722 microversion: 2.20 time: 0.161325 Sep 19 12:36:25.548646 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 429/861] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:25 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:25.761432 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-6fc0dadd-b64b-42e3-a574-e057828f459a tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:25.762046 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-6fc0dadd-b64b-42e3-a574-e057828f459a tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:25.768223 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6fc0dadd-b64b-42e3-a574-e057828f459a tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:25.768737 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6fc0dadd-b64b-42e3-a574-e057828f459a tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:25.769171 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6fc0dadd-b64b-42e3-a574-e057828f459a tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:25.769857 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6fc0dadd-b64b-42e3-a574-e057828f459a tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:25.770306 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6fc0dadd-b64b-42e3-a574-e057828f459a tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:25.770723 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6fc0dadd-b64b-42e3-a574-e057828f459a tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:25.802336 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6fc0dadd-b64b-42e3-a574-e057828f459a tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:25.802814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6fc0dadd-b64b-42e3-a574-e057828f459a tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:25.803243 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6fc0dadd-b64b-42e3-a574-e057828f459a tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:25.803687 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.objects.instance [None req-6fc0dadd-b64b-42e3-a574-e057828f459a tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lazy-loading 'fault' on Instance uuid 453aad65-dbd1-4959-b4de-68db25577cfb {{(pid=121429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:36:25.844702 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-6fc0dadd-b64b-42e3-a574-e057828f459a tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766abab8ce04417b83175b7a4a8d5f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9c692267e643c5b0e2b8ee8cdc85fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:25.853230 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-6fc0dadd-b64b-42e3-a574-e057828f459a tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb" status: 200 len: 1308 microversion: 2.1 time: 0.095969 Sep 19 12:36:25.853811 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 433/862] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:25 2022] GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:36:26.578588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-afdc4c8f-f8bc-46cd-8537-9707d386e7e6 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:26.579292 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-afdc4c8f-f8bc-46cd-8537-9707d386e7e6 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:26.585915 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-afdc4c8f-f8bc-46cd-8537-9707d386e7e6 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:26.586396 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-afdc4c8f-f8bc-46cd-8537-9707d386e7e6 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:26.586895 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-afdc4c8f-f8bc-46cd-8537-9707d386e7e6 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:26.587594 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-afdc4c8f-f8bc-46cd-8537-9707d386e7e6 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:26.588046 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-afdc4c8f-f8bc-46cd-8537-9707d386e7e6 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:26.588473 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-afdc4c8f-f8bc-46cd-8537-9707d386e7e6 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:26.719695 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-afdc4c8f-f8bc-46cd-8537-9707d386e7e6 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:26.728123 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-afdc4c8f-f8bc-46cd-8537-9707d386e7e6 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:26.729608 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-afdc4c8f-f8bc-46cd-8537-9707d386e7e6 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:26.730808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-afdc4c8f-f8bc-46cd-8537-9707d386e7e6 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1722 microversion: 2.20 time: 0.156123 Sep 19 12:36:26.731375 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 430/863] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:26 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:36:26.877277 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-41fe7a4b-20ba-4f09-9f2c-8fd4012bb45d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:26.877821 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-41fe7a4b-20ba-4f09-9f2c-8fd4012bb45d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] [instance: 453aad65-dbd1-4959-b4de-68db25577cfb] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:26.885358 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-41fe7a4b-20ba-4f09-9f2c-8fd4012bb45d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:26.885846 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-41fe7a4b-20ba-4f09-9f2c-8fd4012bb45d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:26.886288 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-41fe7a4b-20ba-4f09-9f2c-8fd4012bb45d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:26.887025 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-41fe7a4b-20ba-4f09-9f2c-8fd4012bb45d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:26.887482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-41fe7a4b-20ba-4f09-9f2c-8fd4012bb45d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:26.887912 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-41fe7a4b-20ba-4f09-9f2c-8fd4012bb45d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:26.902129 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-41fe7a4b-20ba-4f09-9f2c-8fd4012bb45d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] HTTP exception thrown: Instance 453aad65-dbd1-4959-b4de-68db25577cfb could not be found. Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-41fe7a4b-20ba-4f09-9f2c-8fd4012bb45d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Request method failure captured: Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb HTTP/1.1 Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKGHUoHfDs-zPE4-A_uoeMLVAIOSY2FyxfdEuPOP_X-ChDrOIoyoYV_gdBgqdrUpAidDO5jY0nMv545bmaLIlCEHmokNceZwQM5w4G3CCt2kvAjbF9EL5VmMJxzhv5OcWTaT6RFkXOK9Y321Es1qLd3iN0OAcx1d-8SH6ByXwOOJgNGg Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 6d9c692267e643c5b0e2b8ee8cdc85fe Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-VolumesSnapshotTestJSON-915750527 Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:36:26.903790 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:36:26.905497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6d9c692267e643c5b0e2b8ee8cdc85fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6d9c692267e643c5b0e2b8ee8cdc85fe", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6d9c692267e643c5b0e2b8ee8cdc85fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6d9c692267e643c5b0e2b8ee8cdc85fe"}]}] Sep 19 12:36:26.905497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-VolumesSnapshotTestJSON-915750527 Sep 19 12:36:26.905497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 6d9c692267e643c5b0e2b8ee8cdc85fe Sep 19 12:36:26.905497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-915750527 Sep 19 12:36:26.905497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-VolumesSnapshotTestJSON-915750527-project Sep 19 12:36:26.905497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:36:26.905497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:36:26.905497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 766abab8ce04417b83175b7a4a8d5f0f Sep 19 12:36:26.905497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-VolumesSnapshotTestJSON-915750527-project Sep 19 12:36:26.905497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:36:26.905497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance 453aad65-dbd1-4959-b4de-68db25577cfb could not be found. Sep 19 12:36:26.905497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': '453aad65-dbd1-4959-b4de-68db25577cfb'} Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 453aad65-dbd1-4959-b4de-68db25577cfb could not be found. Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:36:26.906540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:36:26.908178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:36:26.908178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:36:26.908178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:36:26.908178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:36:26.908178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:36:26.908178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:36:26.908178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:36:26.908178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 453aad65-dbd1-4959-b4de-68db25577cfb could not be found. Sep 19 12:36:26.908178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:36:26.908178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:26.908178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:36:26.908178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:26.908178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:26.908178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:26.908178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:36:26.908178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:36:26.908178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 453aad65-dbd1-4959-b4de-68db25577cfb could not be found. Sep 19 12:36:26.908178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:36:26.910167 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-41fe7a4b-20ba-4f09-9f2c-8fd4012bb45d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] Returning 404 to user: Instance 453aad65-dbd1-4959-b4de-68db25577cfb could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:36:26.910167 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-41fe7a4b-20ba-4f09-9f2c-8fd4012bb45d tempest-VolumesSnapshotTestJSON-915750527 tempest-VolumesSnapshotTestJSON-915750527-project] 10.222.0.93 "GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb" status: 404 len: 111 microversion: 2.1 time: 0.031946 Sep 19 12:36:26.910167 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 434/864] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:26 2022] GET /compute/v2.1/servers/453aad65-dbd1-4959-b4de-68db25577cfb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:36:27.756980 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-afbf9021-709a-46ce-a3f9-ad7108369abd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:27.757530 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-afbf9021-709a-46ce-a3f9-ad7108369abd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:27.763973 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-afbf9021-709a-46ce-a3f9-ad7108369abd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:27.764443 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-afbf9021-709a-46ce-a3f9-ad7108369abd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:27.764938 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-afbf9021-709a-46ce-a3f9-ad7108369abd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:27.765620 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-afbf9021-709a-46ce-a3f9-ad7108369abd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:27.766062 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-afbf9021-709a-46ce-a3f9-ad7108369abd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:27.766480 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-afbf9021-709a-46ce-a3f9-ad7108369abd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:28.050286 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-afbf9021-709a-46ce-a3f9-ad7108369abd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:28.058449 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-afbf9021-709a-46ce-a3f9-ad7108369abd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:28.059912 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-afbf9021-709a-46ce-a3f9-ad7108369abd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:28.061119 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-afbf9021-709a-46ce-a3f9-ad7108369abd tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1722 microversion: 2.20 time: 0.308597 Sep 19 12:36:28.061680 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 431/865] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:27 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:29.087042 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c24c669b-2d09-49ab-8b7b-8bd086e2edd9 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:29.087628 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c24c669b-2d09-49ab-8b7b-8bd086e2edd9 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:29.094149 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c24c669b-2d09-49ab-8b7b-8bd086e2edd9 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:29.094628 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c24c669b-2d09-49ab-8b7b-8bd086e2edd9 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:29.095058 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c24c669b-2d09-49ab-8b7b-8bd086e2edd9 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:29.095748 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c24c669b-2d09-49ab-8b7b-8bd086e2edd9 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:29.096253 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c24c669b-2d09-49ab-8b7b-8bd086e2edd9 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:29.096696 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c24c669b-2d09-49ab-8b7b-8bd086e2edd9 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:29.228164 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c24c669b-2d09-49ab-8b7b-8bd086e2edd9 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:29.236711 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c24c669b-2d09-49ab-8b7b-8bd086e2edd9 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:29.238166 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c24c669b-2d09-49ab-8b7b-8bd086e2edd9 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:29.239345 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c24c669b-2d09-49ab-8b7b-8bd086e2edd9 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1722 microversion: 2.20 time: 0.156273 Sep 19 12:36:29.239904 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 435/866] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:29 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:30.265995 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-bf9494ff-bd71-4813-99aa-c07350dff000 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:30.266540 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-bf9494ff-bd71-4813-99aa-c07350dff000 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:30.273180 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bf9494ff-bd71-4813-99aa-c07350dff000 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:30.273665 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bf9494ff-bd71-4813-99aa-c07350dff000 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:30.274590 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bf9494ff-bd71-4813-99aa-c07350dff000 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:30.275280 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bf9494ff-bd71-4813-99aa-c07350dff000 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:30.275726 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bf9494ff-bd71-4813-99aa-c07350dff000 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:30.276148 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bf9494ff-bd71-4813-99aa-c07350dff000 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:30.675702 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-bf9494ff-bd71-4813-99aa-c07350dff000 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:30.684199 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-bf9494ff-bd71-4813-99aa-c07350dff000 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:30.685738 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-bf9494ff-bd71-4813-99aa-c07350dff000 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:30.686883 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-bf9494ff-bd71-4813-99aa-c07350dff000 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1722 microversion: 2.20 time: 0.424900 Sep 19 12:36:30.687433 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 432/867] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:30 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1722 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:31.712341 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-305ce201-6f6e-4647-b8be-9c73e069a4a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:31.712969 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-305ce201-6f6e-4647-b8be-9c73e069a4a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:31.719733 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-305ce201-6f6e-4647-b8be-9c73e069a4a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:31.720209 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-305ce201-6f6e-4647-b8be-9c73e069a4a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:31.720669 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-305ce201-6f6e-4647-b8be-9c73e069a4a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:31.721356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-305ce201-6f6e-4647-b8be-9c73e069a4a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:31.721798 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-305ce201-6f6e-4647-b8be-9c73e069a4a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:31.722221 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-305ce201-6f6e-4647-b8be-9c73e069a4a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:31.851863 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-305ce201-6f6e-4647-b8be-9c73e069a4a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:31.860238 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-305ce201-6f6e-4647-b8be-9c73e069a4a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:31.861784 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-305ce201-6f6e-4647-b8be-9c73e069a4a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:31.862943 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-305ce201-6f6e-4647-b8be-9c73e069a4a5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1722 microversion: 2.20 time: 0.155231 Sep 19 12:36:31.863497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 436/868] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:31 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:36:32.889856 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8c470f97-f176-48a6-933c-942117256646 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:32.890462 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-8c470f97-f176-48a6-933c-942117256646 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:32.896879 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8c470f97-f176-48a6-933c-942117256646 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:32.897358 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8c470f97-f176-48a6-933c-942117256646 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:32.897809 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8c470f97-f176-48a6-933c-942117256646 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:32.898472 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8c470f97-f176-48a6-933c-942117256646 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:32.898922 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8c470f97-f176-48a6-933c-942117256646 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:32.899920 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8c470f97-f176-48a6-933c-942117256646 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:33.028700 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-8c470f97-f176-48a6-933c-942117256646 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:33.037155 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-8c470f97-f176-48a6-933c-942117256646 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:33.038672 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-8c470f97-f176-48a6-933c-942117256646 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:33.039849 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8c470f97-f176-48a6-933c-942117256646 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1722 microversion: 2.20 time: 0.153905 Sep 19 12:36:33.040396 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 433/869] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:32 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:34.065361 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-7393914e-f33f-410b-ae55-d40fc3f9ce10 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:34.065876 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-7393914e-f33f-410b-ae55-d40fc3f9ce10 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:34.073044 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7393914e-f33f-410b-ae55-d40fc3f9ce10 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:34.073522 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7393914e-f33f-410b-ae55-d40fc3f9ce10 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:34.073951 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7393914e-f33f-410b-ae55-d40fc3f9ce10 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:34.074636 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7393914e-f33f-410b-ae55-d40fc3f9ce10 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:34.075075 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7393914e-f33f-410b-ae55-d40fc3f9ce10 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:34.075497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7393914e-f33f-410b-ae55-d40fc3f9ce10 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:34.203363 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-7393914e-f33f-410b-ae55-d40fc3f9ce10 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:34.211859 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-7393914e-f33f-410b-ae55-d40fc3f9ce10 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:34.213368 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-7393914e-f33f-410b-ae55-d40fc3f9ce10 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:34.214530 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-7393914e-f33f-410b-ae55-d40fc3f9ce10 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1722 microversion: 2.20 time: 0.153185 Sep 19 12:36:34.215087 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 437/870] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:34 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:35.239400 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-7b8d5d03-6f10-41ee-944c-71a622b38149 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:35.240009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-7b8d5d03-6f10-41ee-944c-71a622b38149 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:35.246378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7b8d5d03-6f10-41ee-944c-71a622b38149 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:35.246857 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7b8d5d03-6f10-41ee-944c-71a622b38149 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:35.247294 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7b8d5d03-6f10-41ee-944c-71a622b38149 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:35.247997 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7b8d5d03-6f10-41ee-944c-71a622b38149 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:35.248437 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7b8d5d03-6f10-41ee-944c-71a622b38149 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:35.248883 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7b8d5d03-6f10-41ee-944c-71a622b38149 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:35.388968 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-7b8d5d03-6f10-41ee-944c-71a622b38149 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:35.397021 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-7b8d5d03-6f10-41ee-944c-71a622b38149 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:35.398466 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-7b8d5d03-6f10-41ee-944c-71a622b38149 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:35.400261 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-7b8d5d03-6f10-41ee-944c-71a622b38149 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1743 microversion: 2.20 time: 0.164854 Sep 19 12:36:35.400841 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 434/871] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:35 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:36.425608 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-8ed801df-5a25-4ee6-bf77-3fdd443dfe43 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:36.426230 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-8ed801df-5a25-4ee6-bf77-3fdd443dfe43 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:36.432846 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8ed801df-5a25-4ee6-bf77-3fdd443dfe43 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:36.433343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8ed801df-5a25-4ee6-bf77-3fdd443dfe43 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:36.433776 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8ed801df-5a25-4ee6-bf77-3fdd443dfe43 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:36.434471 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8ed801df-5a25-4ee6-bf77-3fdd443dfe43 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:36.434913 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8ed801df-5a25-4ee6-bf77-3fdd443dfe43 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:36.435694 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8ed801df-5a25-4ee6-bf77-3fdd443dfe43 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:36.579096 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8ed801df-5a25-4ee6-bf77-3fdd443dfe43 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:36.604872 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8ed801df-5a25-4ee6-bf77-3fdd443dfe43 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:36.606358 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8ed801df-5a25-4ee6-bf77-3fdd443dfe43 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:36.608134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-8ed801df-5a25-4ee6-bf77-3fdd443dfe43 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1743 microversion: 2.20 time: 0.186446 Sep 19 12:36:36.609879 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 438/872] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:36 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1743 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:37.638753 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ca48b946-ce45-4f78-b8ad-82848867fd81 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:37.639515 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-ca48b946-ce45-4f78-b8ad-82848867fd81 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:37.646133 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ca48b946-ce45-4f78-b8ad-82848867fd81 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:37.646933 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ca48b946-ce45-4f78-b8ad-82848867fd81 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:37.647592 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ca48b946-ce45-4f78-b8ad-82848867fd81 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:37.648370 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ca48b946-ce45-4f78-b8ad-82848867fd81 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:37.649694 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ca48b946-ce45-4f78-b8ad-82848867fd81 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:37.650732 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ca48b946-ce45-4f78-b8ad-82848867fd81 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:37.828536 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-ca48b946-ce45-4f78-b8ad-82848867fd81 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:37.838006 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-ca48b946-ce45-4f78-b8ad-82848867fd81 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:37.840003 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-ca48b946-ce45-4f78-b8ad-82848867fd81 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:37.841332 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ca48b946-ce45-4f78-b8ad-82848867fd81 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1738 microversion: 2.20 time: 0.209044 Sep 19 12:36:37.842366 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 435/873] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:37 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:38.668136 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-14045ffe-50cd-4c83-9892-b53121b75cbe req-8a0bc9f5-9cba-4700-a036-9c78d69a5473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73260e21-141c-4941-bdbe-66ee0eeef141", "name": "network-vif-plugged", "status": "completed", "tag": "3bbecd75-6878-45e6-92b1-03e016e3daab"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:36:38.691547 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-14045ffe-50cd-4c83-9892-b53121b75cbe req-8a0bc9f5-9cba-4700-a036-9c78d69a5473 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:38.693172 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-14045ffe-50cd-4c83-9892-b53121b75cbe req-8a0bc9f5-9cba-4700-a036-9c78d69a5473 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:38.693916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-14045ffe-50cd-4c83-9892-b53121b75cbe req-8a0bc9f5-9cba-4700-a036-9c78d69a5473 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:38.709489 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-14045ffe-50cd-4c83-9892-b53121b75cbe req-8a0bc9f5-9cba-4700-a036-9c78d69a5473 service nova] Creating event network-vif-plugged:3bbecd75-6878-45e6-92b1-03e016e3daab for instance 73260e21-141c-4941-bdbe-66ee0eeef141 on hv-cinder-85061 Sep 19 12:36:38.716589 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-14045ffe-50cd-4c83-9892-b53121b75cbe req-8a0bc9f5-9cba-4700-a036-9c78d69a5473 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052227 Sep 19 12:36:38.717784 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 439/874] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:36:38.877151 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-184b80cf-23d0-4aef-9807-89547bf71d59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:38.877982 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-184b80cf-23d0-4aef-9807-89547bf71d59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:38.889275 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-184b80cf-23d0-4aef-9807-89547bf71d59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:38.890148 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-184b80cf-23d0-4aef-9807-89547bf71d59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:38.890556 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-184b80cf-23d0-4aef-9807-89547bf71d59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:38.891424 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-184b80cf-23d0-4aef-9807-89547bf71d59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:38.892086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-184b80cf-23d0-4aef-9807-89547bf71d59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:38.892694 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-184b80cf-23d0-4aef-9807-89547bf71d59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:39.042590 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-184b80cf-23d0-4aef-9807-89547bf71d59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:39.054068 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-184b80cf-23d0-4aef-9807-89547bf71d59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:39.055705 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-184b80cf-23d0-4aef-9807-89547bf71d59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:39.057012 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-184b80cf-23d0-4aef-9807-89547bf71d59 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1738 microversion: 2.20 time: 0.183809 Sep 19 12:36:39.057657 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 436/875] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:38 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:40.090191 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-f580cb50-da8d-4d8e-b623-9798e4dc4292 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:40.091008 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-f580cb50-da8d-4d8e-b623-9798e4dc4292 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:40.103097 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f580cb50-da8d-4d8e-b623-9798e4dc4292 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:40.104876 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f580cb50-da8d-4d8e-b623-9798e4dc4292 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:40.104876 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f580cb50-da8d-4d8e-b623-9798e4dc4292 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:40.105615 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f580cb50-da8d-4d8e-b623-9798e4dc4292 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:40.105869 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f580cb50-da8d-4d8e-b623-9798e4dc4292 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:40.106562 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f580cb50-da8d-4d8e-b623-9798e4dc4292 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:40.258034 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-f580cb50-da8d-4d8e-b623-9798e4dc4292 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:40.266880 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-f580cb50-da8d-4d8e-b623-9798e4dc4292 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:40.268345 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-f580cb50-da8d-4d8e-b623-9798e4dc4292 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:40.269550 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-f580cb50-da8d-4d8e-b623-9798e4dc4292 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1738 microversion: 2.20 time: 0.185769 Sep 19 12:36:40.270148 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 440/876] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:40 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:41.298446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-510734ca-e70e-4f3b-9f34-3e9cc58f721d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:41.300912 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-510734ca-e70e-4f3b-9f34-3e9cc58f721d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:41.311927 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-510734ca-e70e-4f3b-9f34-3e9cc58f721d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:41.312661 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-510734ca-e70e-4f3b-9f34-3e9cc58f721d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:41.313321 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-510734ca-e70e-4f3b-9f34-3e9cc58f721d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:41.314212 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-510734ca-e70e-4f3b-9f34-3e9cc58f721d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:41.314835 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-510734ca-e70e-4f3b-9f34-3e9cc58f721d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:41.315420 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-510734ca-e70e-4f3b-9f34-3e9cc58f721d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:41.321305 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:36:41.491003 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-510734ca-e70e-4f3b-9f34-3e9cc58f721d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:41.501065 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-510734ca-e70e-4f3b-9f34-3e9cc58f721d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:41.502814 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-510734ca-e70e-4f3b-9f34-3e9cc58f721d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:41.504235 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-510734ca-e70e-4f3b-9f34-3e9cc58f721d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1738 microversion: 2.20 time: 0.211345 Sep 19 12:36:41.505436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 437/877] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:41 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:42.530259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-43bb4503-28e9-4eee-8124-5bf5e6d1a882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:42.530878 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-43bb4503-28e9-4eee-8124-5bf5e6d1a882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:42.538271 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-43bb4503-28e9-4eee-8124-5bf5e6d1a882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:42.538767 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-43bb4503-28e9-4eee-8124-5bf5e6d1a882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:42.539540 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-43bb4503-28e9-4eee-8124-5bf5e6d1a882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:42.540394 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-43bb4503-28e9-4eee-8124-5bf5e6d1a882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:42.541019 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-43bb4503-28e9-4eee-8124-5bf5e6d1a882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:42.541602 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-43bb4503-28e9-4eee-8124-5bf5e6d1a882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:42.710610 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-43bb4503-28e9-4eee-8124-5bf5e6d1a882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:42.722252 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-43bb4503-28e9-4eee-8124-5bf5e6d1a882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:42.726094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-43bb4503-28e9-4eee-8124-5bf5e6d1a882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:42.728402 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-43bb4503-28e9-4eee-8124-5bf5e6d1a882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1738 microversion: 2.20 time: 0.202194 Sep 19 12:36:42.742611 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 441/878] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:42 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:43.757941 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-90bda4ea-d8c3-41db-b9a2-5d3d90cd07f2 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:43.758995 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-90bda4ea-d8c3-41db-b9a2-5d3d90cd07f2 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:43.766470 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-90bda4ea-d8c3-41db-b9a2-5d3d90cd07f2 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:43.767290 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-90bda4ea-d8c3-41db-b9a2-5d3d90cd07f2 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:43.767722 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-90bda4ea-d8c3-41db-b9a2-5d3d90cd07f2 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:43.768414 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-90bda4ea-d8c3-41db-b9a2-5d3d90cd07f2 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:43.768878 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-90bda4ea-d8c3-41db-b9a2-5d3d90cd07f2 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:43.769721 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-90bda4ea-d8c3-41db-b9a2-5d3d90cd07f2 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:43.938681 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-90bda4ea-d8c3-41db-b9a2-5d3d90cd07f2 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:43.948187 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-90bda4ea-d8c3-41db-b9a2-5d3d90cd07f2 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:43.949712 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-90bda4ea-d8c3-41db-b9a2-5d3d90cd07f2 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:43.951129 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-90bda4ea-d8c3-41db-b9a2-5d3d90cd07f2 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1738 microversion: 2.20 time: 0.197659 Sep 19 12:36:43.951692 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 438/879] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:43 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:36:44.978166 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2d5bfdb4-e312-4c46-8cc8-94334c41ea1f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:44.979008 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2d5bfdb4-e312-4c46-8cc8-94334c41ea1f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:44.986584 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2d5bfdb4-e312-4c46-8cc8-94334c41ea1f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:44.992515 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2d5bfdb4-e312-4c46-8cc8-94334c41ea1f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:44.992515 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2d5bfdb4-e312-4c46-8cc8-94334c41ea1f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:44.992515 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2d5bfdb4-e312-4c46-8cc8-94334c41ea1f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:44.992515 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2d5bfdb4-e312-4c46-8cc8-94334c41ea1f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:44.993078 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2d5bfdb4-e312-4c46-8cc8-94334c41ea1f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:45.151553 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2d5bfdb4-e312-4c46-8cc8-94334c41ea1f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:45.160506 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2d5bfdb4-e312-4c46-8cc8-94334c41ea1f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:45.162425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2d5bfdb4-e312-4c46-8cc8-94334c41ea1f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:45.163962 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2d5bfdb4-e312-4c46-8cc8-94334c41ea1f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1738 microversion: 2.20 time: 0.190092 Sep 19 12:36:45.164658 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 442/880] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:44 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:36:46.191319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-5936fe2d-b292-4f3b-b97b-02ec094ccede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:46.191919 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-5936fe2d-b292-4f3b-b97b-02ec094ccede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:46.198552 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5936fe2d-b292-4f3b-b97b-02ec094ccede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:46.199028 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5936fe2d-b292-4f3b-b97b-02ec094ccede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:46.199455 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5936fe2d-b292-4f3b-b97b-02ec094ccede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:46.200148 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5936fe2d-b292-4f3b-b97b-02ec094ccede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:46.200619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5936fe2d-b292-4f3b-b97b-02ec094ccede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:46.201044 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5936fe2d-b292-4f3b-b97b-02ec094ccede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:46.331917 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5936fe2d-b292-4f3b-b97b-02ec094ccede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:46.343298 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5936fe2d-b292-4f3b-b97b-02ec094ccede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:46.345153 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5936fe2d-b292-4f3b-b97b-02ec094ccede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:46.346486 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-5936fe2d-b292-4f3b-b97b-02ec094ccede tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1738 microversion: 2.20 time: 0.159079 Sep 19 12:36:46.347110 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 439/881] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:46 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:47.377906 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-f43f82d7-59a1-47c3-817a-08a0a6dca96f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:47.378514 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-f43f82d7-59a1-47c3-817a-08a0a6dca96f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:47.385495 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f43f82d7-59a1-47c3-817a-08a0a6dca96f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:47.385495 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f43f82d7-59a1-47c3-817a-08a0a6dca96f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:47.385961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f43f82d7-59a1-47c3-817a-08a0a6dca96f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:47.386635 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f43f82d7-59a1-47c3-817a-08a0a6dca96f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:47.387079 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f43f82d7-59a1-47c3-817a-08a0a6dca96f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:47.387497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f43f82d7-59a1-47c3-817a-08a0a6dca96f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:47.526572 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-f43f82d7-59a1-47c3-817a-08a0a6dca96f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:47.534800 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-f43f82d7-59a1-47c3-817a-08a0a6dca96f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:47.536284 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-f43f82d7-59a1-47c3-817a-08a0a6dca96f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:47.537528 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-f43f82d7-59a1-47c3-817a-08a0a6dca96f tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1738 microversion: 2.20 time: 0.163572 Sep 19 12:36:47.541669 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 443/882] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:47 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:48.565630 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-bc84083a-be72-42d4-984e-52ec74686750 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:48.566392 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-bc84083a-be72-42d4-984e-52ec74686750 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:48.573480 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bc84083a-be72-42d4-984e-52ec74686750 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:48.573978 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bc84083a-be72-42d4-984e-52ec74686750 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:48.574391 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bc84083a-be72-42d4-984e-52ec74686750 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:48.575099 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bc84083a-be72-42d4-984e-52ec74686750 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:48.575543 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bc84083a-be72-42d4-984e-52ec74686750 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:48.576124 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bc84083a-be72-42d4-984e-52ec74686750 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:48.814969 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-bc84083a-be72-42d4-984e-52ec74686750 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:48.823519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-bc84083a-be72-42d4-984e-52ec74686750 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:48.824901 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-bc84083a-be72-42d4-984e-52ec74686750 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:48.826089 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-bc84083a-be72-42d4-984e-52ec74686750 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1720 microversion: 2.20 time: 0.265114 Sep 19 12:36:48.826646 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 440/883] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:48 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1720 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:49.851888 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-a02a818f-7682-4040-bcc5-00b7144e52e3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:49.855658 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-a02a818f-7682-4040-bcc5-00b7144e52e3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:49.859401 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a02a818f-7682-4040-bcc5-00b7144e52e3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:49.859896 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a02a818f-7682-4040-bcc5-00b7144e52e3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:49.860338 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a02a818f-7682-4040-bcc5-00b7144e52e3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:49.861081 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a02a818f-7682-4040-bcc5-00b7144e52e3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:49.861538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a02a818f-7682-4040-bcc5-00b7144e52e3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:49.861967 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a02a818f-7682-4040-bcc5-00b7144e52e3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:50.000641 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-a02a818f-7682-4040-bcc5-00b7144e52e3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:50.003142 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:36:50.011086 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-a02a818f-7682-4040-bcc5-00b7144e52e3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:50.012548 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-a02a818f-7682-4040-bcc5-00b7144e52e3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:50.016310 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-a02a818f-7682-4040-bcc5-00b7144e52e3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1720 microversion: 2.20 time: 0.166226 Sep 19 12:36:50.016310 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 444/884] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:49 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:51.039286 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e4b4761c-1d55-4207-ad3b-884ec26531aa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:51.039901 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e4b4761c-1d55-4207-ad3b-884ec26531aa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:51.046398 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e4b4761c-1d55-4207-ad3b-884ec26531aa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:51.046914 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e4b4761c-1d55-4207-ad3b-884ec26531aa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:51.047354 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e4b4761c-1d55-4207-ad3b-884ec26531aa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:51.048048 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e4b4761c-1d55-4207-ad3b-884ec26531aa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:51.048507 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e4b4761c-1d55-4207-ad3b-884ec26531aa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:51.048952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e4b4761c-1d55-4207-ad3b-884ec26531aa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:51.187978 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e4b4761c-1d55-4207-ad3b-884ec26531aa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:51.197964 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e4b4761c-1d55-4207-ad3b-884ec26531aa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:51.199543 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e4b4761c-1d55-4207-ad3b-884ec26531aa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:51.200772 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e4b4761c-1d55-4207-ad3b-884ec26531aa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1720 microversion: 2.20 time: 0.165427 Sep 19 12:36:51.201338 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 441/885] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:51 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:52.227660 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-dd1b306c-2e59-4a07-88fc-520f5cea0136 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:52.228257 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-dd1b306c-2e59-4a07-88fc-520f5cea0136 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:52.231897 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=37 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:36:52.236059 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dd1b306c-2e59-4a07-88fc-520f5cea0136 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:52.236535 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dd1b306c-2e59-4a07-88fc-520f5cea0136 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:52.236990 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dd1b306c-2e59-4a07-88fc-520f5cea0136 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:52.237687 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dd1b306c-2e59-4a07-88fc-520f5cea0136 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:52.238134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dd1b306c-2e59-4a07-88fc-520f5cea0136 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:52.238558 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-dd1b306c-2e59-4a07-88fc-520f5cea0136 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:52.369626 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-dd1b306c-2e59-4a07-88fc-520f5cea0136 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:52.377794 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-dd1b306c-2e59-4a07-88fc-520f5cea0136 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:52.379427 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-dd1b306c-2e59-4a07-88fc-520f5cea0136 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:52.380580 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-dd1b306c-2e59-4a07-88fc-520f5cea0136 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1663 microversion: 2.20 time: 0.157519 Sep 19 12:36:52.381149 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 445/886] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:52 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:36:52.406217 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-733f1936-0e9c-4cef-ae8b-63ac9db0da18 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "541a58db-3b55-40d1-9183-dec2d294ec34"}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:36:52.408713 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-733f1936-0e9c-4cef-ae8b-63ac9db0da18 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:52.411121 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:36:52.416421 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-733f1936-0e9c-4cef-ae8b-63ac9db0da18 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:52.416973 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-733f1936-0e9c-4cef-ae8b-63ac9db0da18 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:52.417405 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-733f1936-0e9c-4cef-ae8b-63ac9db0da18 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:52.418134 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-733f1936-0e9c-4cef-ae8b-63ac9db0da18 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:52.418587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-733f1936-0e9c-4cef-ae8b-63ac9db0da18 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:52.419012 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-733f1936-0e9c-4cef-ae8b-63ac9db0da18 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:52.684430 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-92922647-2131-4769-b35c-7e658621edaa req-9bdeb834-9a07-4cf5-84e3-4c897a5ea3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73260e21-141c-4941-bdbe-66ee0eeef141", "name": "network-vif-unplugged", "status": "completed", "tag": "3bbecd75-6878-45e6-92b1-03e016e3daab"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:36:52.694627 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-92922647-2131-4769-b35c-7e658621edaa req-9bdeb834-9a07-4cf5-84e3-4c897a5ea3a7 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:52.695114 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-92922647-2131-4769-b35c-7e658621edaa req-9bdeb834-9a07-4cf5-84e3-4c897a5ea3a7 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:52.695556 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-92922647-2131-4769-b35c-7e658621edaa req-9bdeb834-9a07-4cf5-84e3-4c897a5ea3a7 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:52.706755 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.compute.server_external_events [req-92922647-2131-4769-b35c-7e658621edaa req-9bdeb834-9a07-4cf5-84e3-4c897a5ea3a7 service nova] Unable to find a host for instance 73260e21-141c-4941-bdbe-66ee0eeef141. Dropping event network-vif-unplugged {{(pid=121429) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 19 12:36:52.707753 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-92922647-2131-4769-b35c-7e658621edaa req-9bdeb834-9a07-4cf5-84e3-4c897a5ea3a7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027895 Sep 19 12:36:52.708358 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 446/887] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 19 12:36:53.590760 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-733f1936-0e9c-4cef-ae8b-63ac9db0da18 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "POST /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.188201 Sep 19 12:36:53.591516 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 442/888] 10.222.0.93 () {62 vars in 1364 bytes} [Mon Sep 19 12:36:52 2022] POST /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141/os-volume_attachments => generated 188 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:36:53.751989 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4c9c035d-3660-44e3-9c82-d0b516639a84 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:53.752528 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4c9c035d-3660-44e3-9c82-d0b516639a84 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:53.759876 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4c9c035d-3660-44e3-9c82-d0b516639a84 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:53.760358 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4c9c035d-3660-44e3-9c82-d0b516639a84 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:53.760827 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4c9c035d-3660-44e3-9c82-d0b516639a84 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:53.761601 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4c9c035d-3660-44e3-9c82-d0b516639a84 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:53.762088 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4c9c035d-3660-44e3-9c82-d0b516639a84 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:53.762487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4c9c035d-3660-44e3-9c82-d0b516639a84 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:54.481112 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4c9c035d-3660-44e3-9c82-d0b516639a84 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "DELETE /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141/os-volume_attachments/541a58db-3b55-40d1-9183-dec2d294ec34" status: 202 len: 0 microversion: 2.20 time: 0.732968 Sep 19 12:36:54.481837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 447/889] 10.222.0.93 () {60 vars in 1457 bytes} [Mon Sep 19 12:36:53 2022] DELETE /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141/os-volume_attachments/541a58db-3b55-40d1-9183-dec2d294ec34 => generated 0 bytes in 735 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:36:54.549301 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ea2e62ae-1fb3-4651-8c59-01106cb9e461 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:36:54.549301 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-ea2e62ae-1fb3-4651-8c59-01106cb9e461 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:54.553189 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ea2e62ae-1fb3-4651-8c59-01106cb9e461 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:54.553675 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ea2e62ae-1fb3-4651-8c59-01106cb9e461 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:54.554112 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ea2e62ae-1fb3-4651-8c59-01106cb9e461 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:54.554796 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ea2e62ae-1fb3-4651-8c59-01106cb9e461 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:54.555245 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ea2e62ae-1fb3-4651-8c59-01106cb9e461 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:54.555655 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ea2e62ae-1fb3-4651-8c59-01106cb9e461 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:54.586899 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-ea2e62ae-1fb3-4651-8c59-01106cb9e461 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121428) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 12:36:54.981001 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ea2e62ae-1fb3-4651-8c59-01106cb9e461 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "POST /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141/action" status: 202 len: 0 microversion: 2.20 time: 0.438869 Sep 19 12:36:54.981696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 443/890] 10.222.0.93 () {62 vars in 1319 bytes} [Mon Sep 19 12:36:54 2022] POST /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:36:54.990446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-06265ca3-f211-4222-8c54-fdc284463a5b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:54.991239 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-06265ca3-f211-4222-8c54-fdc284463a5b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:54.998591 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-06265ca3-f211-4222-8c54-fdc284463a5b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:54.999081 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-06265ca3-f211-4222-8c54-fdc284463a5b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:54.999715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-06265ca3-f211-4222-8c54-fdc284463a5b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:55.000465 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-06265ca3-f211-4222-8c54-fdc284463a5b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:55.001140 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-06265ca3-f211-4222-8c54-fdc284463a5b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:55.001544 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-06265ca3-f211-4222-8c54-fdc284463a5b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:55.150303 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-06265ca3-f211-4222-8c54-fdc284463a5b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:55.158260 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-06265ca3-f211-4222-8c54-fdc284463a5b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:55.159706 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-06265ca3-f211-4222-8c54-fdc284463a5b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:55.160949 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-06265ca3-f211-4222-8c54-fdc284463a5b tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1671 microversion: 2.20 time: 0.174861 Sep 19 12:36:55.161552 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 448/891] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:54 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:56.187682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-2a0afd1b-6e34-4986-b569-9bdd1f6f5bfa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:56.188325 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-2a0afd1b-6e34-4986-b569-9bdd1f6f5bfa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:56.195776 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2a0afd1b-6e34-4986-b569-9bdd1f6f5bfa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:56.200037 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2a0afd1b-6e34-4986-b569-9bdd1f6f5bfa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:56.200037 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2a0afd1b-6e34-4986-b569-9bdd1f6f5bfa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:56.200037 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2a0afd1b-6e34-4986-b569-9bdd1f6f5bfa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:56.200037 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2a0afd1b-6e34-4986-b569-9bdd1f6f5bfa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:56.200425 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2a0afd1b-6e34-4986-b569-9bdd1f6f5bfa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:56.357231 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2a0afd1b-6e34-4986-b569-9bdd1f6f5bfa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:56.366187 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2a0afd1b-6e34-4986-b569-9bdd1f6f5bfa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:56.367681 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2a0afd1b-6e34-4986-b569-9bdd1f6f5bfa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:56.368892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-2a0afd1b-6e34-4986-b569-9bdd1f6f5bfa tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1673 microversion: 2.20 time: 0.185899 Sep 19 12:36:56.369508 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 444/892] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:56 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1673 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:57.396524 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-018d4001-1a57-4173-80fc-59c468d4da9d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:57.397106 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-018d4001-1a57-4173-80fc-59c468d4da9d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:57.404139 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-018d4001-1a57-4173-80fc-59c468d4da9d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:57.404648 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-018d4001-1a57-4173-80fc-59c468d4da9d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:57.405083 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-018d4001-1a57-4173-80fc-59c468d4da9d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:57.405770 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-018d4001-1a57-4173-80fc-59c468d4da9d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:57.406219 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-018d4001-1a57-4173-80fc-59c468d4da9d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:57.406637 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-018d4001-1a57-4173-80fc-59c468d4da9d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:57.544184 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-018d4001-1a57-4173-80fc-59c468d4da9d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:57.552535 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-018d4001-1a57-4173-80fc-59c468d4da9d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:57.554056 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-018d4001-1a57-4173-80fc-59c468d4da9d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:57.555278 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-018d4001-1a57-4173-80fc-59c468d4da9d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1729 microversion: 2.20 time: 0.162856 Sep 19 12:36:57.555867 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 449/893] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:57 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:36:58.583409 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e46c09ad-e293-4f67-8bd3-52498f97d9e5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:58.584098 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e46c09ad-e293-4f67-8bd3-52498f97d9e5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:58.592019 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e46c09ad-e293-4f67-8bd3-52498f97d9e5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:58.592817 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e46c09ad-e293-4f67-8bd3-52498f97d9e5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:58.593588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e46c09ad-e293-4f67-8bd3-52498f97d9e5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:58.594615 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e46c09ad-e293-4f67-8bd3-52498f97d9e5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:58.596125 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e46c09ad-e293-4f67-8bd3-52498f97d9e5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:58.596993 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e46c09ad-e293-4f67-8bd3-52498f97d9e5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:58.740710 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e46c09ad-e293-4f67-8bd3-52498f97d9e5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:58.751619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e46c09ad-e293-4f67-8bd3-52498f97d9e5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:58.753200 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e46c09ad-e293-4f67-8bd3-52498f97d9e5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:58.754779 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e46c09ad-e293-4f67-8bd3-52498f97d9e5 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1729 microversion: 2.20 time: 0.176797 Sep 19 12:36:58.755346 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 445/894] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:58 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:36:59.790400 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-219e976c-8af4-48b9-b686-0b8a5727a12c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:59.790992 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-219e976c-8af4-48b9-b686-0b8a5727a12c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:59.802236 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-219e976c-8af4-48b9-b686-0b8a5727a12c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:59.803134 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-219e976c-8af4-48b9-b686-0b8a5727a12c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:59.803837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-219e976c-8af4-48b9-b686-0b8a5727a12c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:59.805410 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-219e976c-8af4-48b9-b686-0b8a5727a12c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:59.806275 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-219e976c-8af4-48b9-b686-0b8a5727a12c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:59.807104 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-219e976c-8af4-48b9-b686-0b8a5727a12c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:59.996594 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-219e976c-8af4-48b9-b686-0b8a5727a12c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:00.011557 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-219e976c-8af4-48b9-b686-0b8a5727a12c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:00.014164 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-219e976c-8af4-48b9-b686-0b8a5727a12c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:00.015395 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-219e976c-8af4-48b9-b686-0b8a5727a12c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1729 microversion: 2.20 time: 0.229176 Sep 19 12:37:00.016088 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 450/895] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:36:59 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:37:01.050533 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-6a8feb79-677d-44ee-b44a-16dac4543ff0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:01.051424 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6a8feb79-677d-44ee-b44a-16dac4543ff0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:01.059612 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6a8feb79-677d-44ee-b44a-16dac4543ff0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:01.060093 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6a8feb79-677d-44ee-b44a-16dac4543ff0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:01.060544 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6a8feb79-677d-44ee-b44a-16dac4543ff0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:01.061421 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6a8feb79-677d-44ee-b44a-16dac4543ff0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:01.062073 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6a8feb79-677d-44ee-b44a-16dac4543ff0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:01.062491 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6a8feb79-677d-44ee-b44a-16dac4543ff0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:01.265747 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-6a8feb79-677d-44ee-b44a-16dac4543ff0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:01.275706 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-6a8feb79-677d-44ee-b44a-16dac4543ff0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:01.277226 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-6a8feb79-677d-44ee-b44a-16dac4543ff0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:01.278450 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-6a8feb79-677d-44ee-b44a-16dac4543ff0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1729 microversion: 2.20 time: 0.232420 Sep 19 12:37:01.282133 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 446/896] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:01 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1729 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:37:02.305270 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-518a9a71-6571-411d-8f76-ddfbdde556d3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:02.305884 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-518a9a71-6571-411d-8f76-ddfbdde556d3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:02.313522 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-518a9a71-6571-411d-8f76-ddfbdde556d3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:02.313787 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-518a9a71-6571-411d-8f76-ddfbdde556d3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:02.314460 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-518a9a71-6571-411d-8f76-ddfbdde556d3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:02.315492 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-518a9a71-6571-411d-8f76-ddfbdde556d3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:02.316014 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-518a9a71-6571-411d-8f76-ddfbdde556d3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:02.316642 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-518a9a71-6571-411d-8f76-ddfbdde556d3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:02.466819 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-518a9a71-6571-411d-8f76-ddfbdde556d3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:02.479055 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-518a9a71-6571-411d-8f76-ddfbdde556d3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:02.481048 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-518a9a71-6571-411d-8f76-ddfbdde556d3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:02.482421 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-518a9a71-6571-411d-8f76-ddfbdde556d3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1729 microversion: 2.20 time: 0.181764 Sep 19 12:37:02.485629 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 451/897] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:02 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:37:03.511992 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-9ccae28e-a989-4d0a-8d64-88d7025dd426 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:03.512703 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-9ccae28e-a989-4d0a-8d64-88d7025dd426 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:03.523887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9ccae28e-a989-4d0a-8d64-88d7025dd426 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:03.523887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9ccae28e-a989-4d0a-8d64-88d7025dd426 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:03.523887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9ccae28e-a989-4d0a-8d64-88d7025dd426 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:03.523887 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9ccae28e-a989-4d0a-8d64-88d7025dd426 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:03.524309 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9ccae28e-a989-4d0a-8d64-88d7025dd426 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:03.524462 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9ccae28e-a989-4d0a-8d64-88d7025dd426 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:03.698987 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-9ccae28e-a989-4d0a-8d64-88d7025dd426 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:03.709582 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-9ccae28e-a989-4d0a-8d64-88d7025dd426 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:03.711221 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-9ccae28e-a989-4d0a-8d64-88d7025dd426 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:03.712699 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-9ccae28e-a989-4d0a-8d64-88d7025dd426 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1729 microversion: 2.20 time: 0.205957 Sep 19 12:37:03.713383 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 447/898] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:03 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:37:04.980230 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-d153db5c-0308-469d-92b4-7d803a2e7f15 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:04.980912 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-d153db5c-0308-469d-92b4-7d803a2e7f15 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:04.987385 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d153db5c-0308-469d-92b4-7d803a2e7f15 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:04.987909 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d153db5c-0308-469d-92b4-7d803a2e7f15 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:04.988372 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d153db5c-0308-469d-92b4-7d803a2e7f15 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:04.989835 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d153db5c-0308-469d-92b4-7d803a2e7f15 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:04.990287 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d153db5c-0308-469d-92b4-7d803a2e7f15 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:04.990772 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-d153db5c-0308-469d-92b4-7d803a2e7f15 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:05.192689 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-d153db5c-0308-469d-92b4-7d803a2e7f15 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:05.210124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-d153db5c-0308-469d-92b4-7d803a2e7f15 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:05.212858 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-d153db5c-0308-469d-92b4-7d803a2e7f15 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:05.214657 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-d153db5c-0308-469d-92b4-7d803a2e7f15 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1729 microversion: 2.20 time: 0.477300 Sep 19 12:37:05.215315 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 452/899] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:04 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1729 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:37:06.243224 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-2f3f792b-d0fd-4ea1-b803-7568de099407 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:06.244097 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-2f3f792b-d0fd-4ea1-b803-7568de099407 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:06.250348 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f3f792b-d0fd-4ea1-b803-7568de099407 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:06.250836 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f3f792b-d0fd-4ea1-b803-7568de099407 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:06.251310 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f3f792b-d0fd-4ea1-b803-7568de099407 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:06.252020 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f3f792b-d0fd-4ea1-b803-7568de099407 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:06.252460 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f3f792b-d0fd-4ea1-b803-7568de099407 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:06.252918 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2f3f792b-d0fd-4ea1-b803-7568de099407 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:06.394719 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2f3f792b-d0fd-4ea1-b803-7568de099407 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:06.403148 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2f3f792b-d0fd-4ea1-b803-7568de099407 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:06.404587 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2f3f792b-d0fd-4ea1-b803-7568de099407 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:06.405771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-2f3f792b-d0fd-4ea1-b803-7568de099407 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1729 microversion: 2.20 time: 0.166890 Sep 19 12:37:06.406325 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 448/900] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:06 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:37:07.431060 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-a4302ad8-57ab-441c-be84-46e2b28113c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:07.431692 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-a4302ad8-57ab-441c-be84-46e2b28113c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:07.439022 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a4302ad8-57ab-441c-be84-46e2b28113c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:07.439628 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a4302ad8-57ab-441c-be84-46e2b28113c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:07.439983 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a4302ad8-57ab-441c-be84-46e2b28113c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:07.448947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a4302ad8-57ab-441c-be84-46e2b28113c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:07.448947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a4302ad8-57ab-441c-be84-46e2b28113c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:07.448947 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a4302ad8-57ab-441c-be84-46e2b28113c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:07.574635 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-a4302ad8-57ab-441c-be84-46e2b28113c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:07.582767 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-a4302ad8-57ab-441c-be84-46e2b28113c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:07.584295 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-a4302ad8-57ab-441c-be84-46e2b28113c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:07.586169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-a4302ad8-57ab-441c-be84-46e2b28113c0 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1729 microversion: 2.20 time: 0.158506 Sep 19 12:37:07.586608 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 453/901] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:07 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:37:08.610658 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b52e7ac4-597e-4662-a533-722cb5ad5b4d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:08.611264 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-b52e7ac4-597e-4662-a533-722cb5ad5b4d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:08.617732 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b52e7ac4-597e-4662-a533-722cb5ad5b4d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:08.618211 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b52e7ac4-597e-4662-a533-722cb5ad5b4d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:08.618640 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b52e7ac4-597e-4662-a533-722cb5ad5b4d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:08.619657 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b52e7ac4-597e-4662-a533-722cb5ad5b4d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:08.619782 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b52e7ac4-597e-4662-a533-722cb5ad5b4d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:08.620171 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b52e7ac4-597e-4662-a533-722cb5ad5b4d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:08.764384 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-b52e7ac4-597e-4662-a533-722cb5ad5b4d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:08.772821 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-b52e7ac4-597e-4662-a533-722cb5ad5b4d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:08.774778 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-b52e7ac4-597e-4662-a533-722cb5ad5b4d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:08.775952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-b52e7ac4-597e-4662-a533-722cb5ad5b4d tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1729 microversion: 2.20 time: 0.169271 Sep 19 12:37:08.776514 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 449/902] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:08 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:37:09.802011 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e83cdbef-91bb-4e31-bf87-fbceb5f40a02 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:09.802575 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-e83cdbef-91bb-4e31-bf87-fbceb5f40a02 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:09.808998 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e83cdbef-91bb-4e31-bf87-fbceb5f40a02 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:09.809477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e83cdbef-91bb-4e31-bf87-fbceb5f40a02 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:09.809911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e83cdbef-91bb-4e31-bf87-fbceb5f40a02 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:09.810630 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e83cdbef-91bb-4e31-bf87-fbceb5f40a02 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:09.811231 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e83cdbef-91bb-4e31-bf87-fbceb5f40a02 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:09.811658 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e83cdbef-91bb-4e31-bf87-fbceb5f40a02 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:09.945335 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e83cdbef-91bb-4e31-bf87-fbceb5f40a02 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:09.954231 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e83cdbef-91bb-4e31-bf87-fbceb5f40a02 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:09.955692 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e83cdbef-91bb-4e31-bf87-fbceb5f40a02 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:09.956954 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e83cdbef-91bb-4e31-bf87-fbceb5f40a02 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1729 microversion: 2.20 time: 0.158966 Sep 19 12:37:09.957534 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 454/903] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:09 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:37:10.984305 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-9dc68120-c18c-47f5-bd40-581aed819b47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:10.985251 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-9dc68120-c18c-47f5-bd40-581aed819b47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:10.991968 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9dc68120-c18c-47f5-bd40-581aed819b47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:10.992464 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9dc68120-c18c-47f5-bd40-581aed819b47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:10.993128 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9dc68120-c18c-47f5-bd40-581aed819b47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:10.993858 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9dc68120-c18c-47f5-bd40-581aed819b47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:10.994317 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9dc68120-c18c-47f5-bd40-581aed819b47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:10.994751 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9dc68120-c18c-47f5-bd40-581aed819b47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:10.999506 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:37:11.146186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-9dc68120-c18c-47f5-bd40-581aed819b47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:11.157386 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-9dc68120-c18c-47f5-bd40-581aed819b47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:11.159254 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-9dc68120-c18c-47f5-bd40-581aed819b47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:11.160026 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-9dc68120-c18c-47f5-bd40-581aed819b47 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1729 microversion: 2.20 time: 0.180058 Sep 19 12:37:11.164646 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 450/904] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:10 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:37:12.187139 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2439b862-4822-4be5-ab5b-ccfdf2a6f697 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:12.187847 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2439b862-4822-4be5-ab5b-ccfdf2a6f697 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:12.194807 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2439b862-4822-4be5-ab5b-ccfdf2a6f697 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:12.195305 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2439b862-4822-4be5-ab5b-ccfdf2a6f697 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:12.195922 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2439b862-4822-4be5-ab5b-ccfdf2a6f697 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:12.196676 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2439b862-4822-4be5-ab5b-ccfdf2a6f697 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:12.197138 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2439b862-4822-4be5-ab5b-ccfdf2a6f697 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:12.197558 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2439b862-4822-4be5-ab5b-ccfdf2a6f697 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:12.349896 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2439b862-4822-4be5-ab5b-ccfdf2a6f697 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:12.359133 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2439b862-4822-4be5-ab5b-ccfdf2a6f697 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:12.360649 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2439b862-4822-4be5-ab5b-ccfdf2a6f697 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:12.361832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2439b862-4822-4be5-ab5b-ccfdf2a6f697 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1729 microversion: 2.20 time: 0.178730 Sep 19 12:37:12.362404 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 455/905] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:12 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:37:12.867786 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-c3676b05-5048-42a9-ada4-2ae2c63def87 req-1f43a85b-ef4c-41a1-a6bc-a3522a23e81e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73260e21-141c-4941-bdbe-66ee0eeef141", "name": "network-vif-plugged", "status": "completed", "tag": "3bbecd75-6878-45e6-92b1-03e016e3daab"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:37:12.883951 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-c3676b05-5048-42a9-ada4-2ae2c63def87 req-1f43a85b-ef4c-41a1-a6bc-a3522a23e81e service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:12.884463 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-c3676b05-5048-42a9-ada4-2ae2c63def87 req-1f43a85b-ef4c-41a1-a6bc-a3522a23e81e service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:12.884934 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-c3676b05-5048-42a9-ada4-2ae2c63def87 req-1f43a85b-ef4c-41a1-a6bc-a3522a23e81e service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:12.896739 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-c3676b05-5048-42a9-ada4-2ae2c63def87 req-1f43a85b-ef4c-41a1-a6bc-a3522a23e81e service nova] Creating event network-vif-plugged:3bbecd75-6878-45e6-92b1-03e016e3daab for instance 73260e21-141c-4941-bdbe-66ee0eeef141 on hv-cinder-85061 Sep 19 12:37:12.902875 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-c3676b05-5048-42a9-ada4-2ae2c63def87 req-1f43a85b-ef4c-41a1-a6bc-a3522a23e81e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042875 Sep 19 12:37:12.903607 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 451/906] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:37:13.389724 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3d4ba5fd-e70b-48b0-aa74-49808e42967a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:13.390319 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3d4ba5fd-e70b-48b0-aa74-49808e42967a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:13.397012 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3d4ba5fd-e70b-48b0-aa74-49808e42967a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:13.397499 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3d4ba5fd-e70b-48b0-aa74-49808e42967a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:13.397930 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3d4ba5fd-e70b-48b0-aa74-49808e42967a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:13.398679 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3d4ba5fd-e70b-48b0-aa74-49808e42967a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:13.399127 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3d4ba5fd-e70b-48b0-aa74-49808e42967a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:13.399548 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3d4ba5fd-e70b-48b0-aa74-49808e42967a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:13.546369 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3d4ba5fd-e70b-48b0-aa74-49808e42967a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:13.556888 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3d4ba5fd-e70b-48b0-aa74-49808e42967a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:13.558355 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3d4ba5fd-e70b-48b0-aa74-49808e42967a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:13.559542 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3d4ba5fd-e70b-48b0-aa74-49808e42967a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1729 microversion: 2.20 time: 0.174253 Sep 19 12:37:13.560115 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 456/907] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:13 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:37:14.586532 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-937abdb9-cc83-4c56-b5e9-567c2c8cae8a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:14.587362 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-937abdb9-cc83-4c56-b5e9-567c2c8cae8a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:14.594096 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-937abdb9-cc83-4c56-b5e9-567c2c8cae8a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:14.594589 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-937abdb9-cc83-4c56-b5e9-567c2c8cae8a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:14.595067 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-937abdb9-cc83-4c56-b5e9-567c2c8cae8a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:14.595729 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-937abdb9-cc83-4c56-b5e9-567c2c8cae8a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:14.596176 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-937abdb9-cc83-4c56-b5e9-567c2c8cae8a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:14.596590 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-937abdb9-cc83-4c56-b5e9-567c2c8cae8a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:14.754399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-937abdb9-cc83-4c56-b5e9-567c2c8cae8a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:14.766038 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-937abdb9-cc83-4c56-b5e9-567c2c8cae8a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:14.768282 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-937abdb9-cc83-4c56-b5e9-567c2c8cae8a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:14.769731 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-937abdb9-cc83-4c56-b5e9-567c2c8cae8a tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1729 microversion: 2.20 time: 0.188106 Sep 19 12:37:14.770461 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 452/908] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:14 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:37:15.799692 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2e7afd37-d511-4079-ba49-b99795715f1c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:15.800230 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2e7afd37-d511-4079-ba49-b99795715f1c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:15.806983 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2e7afd37-d511-4079-ba49-b99795715f1c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:15.807470 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2e7afd37-d511-4079-ba49-b99795715f1c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:15.808240 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2e7afd37-d511-4079-ba49-b99795715f1c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:15.808679 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2e7afd37-d511-4079-ba49-b99795715f1c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:15.809131 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2e7afd37-d511-4079-ba49-b99795715f1c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:15.809554 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2e7afd37-d511-4079-ba49-b99795715f1c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:15.970654 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2e7afd37-d511-4079-ba49-b99795715f1c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:15.985321 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2e7afd37-d511-4079-ba49-b99795715f1c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:15.987635 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2e7afd37-d511-4079-ba49-b99795715f1c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:15.989640 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2e7afd37-d511-4079-ba49-b99795715f1c tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1729 microversion: 2.20 time: 0.193723 Sep 19 12:37:15.990323 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 457/909] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:15 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:37:17.021237 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-60e9c7f9-e59a-43a1-96e6-2ddac5ff1a38 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:17.021802 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-60e9c7f9-e59a-43a1-96e6-2ddac5ff1a38 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:17.029318 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-60e9c7f9-e59a-43a1-96e6-2ddac5ff1a38 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:17.029828 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-60e9c7f9-e59a-43a1-96e6-2ddac5ff1a38 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:17.030252 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-60e9c7f9-e59a-43a1-96e6-2ddac5ff1a38 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:17.030970 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-60e9c7f9-e59a-43a1-96e6-2ddac5ff1a38 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:17.031421 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-60e9c7f9-e59a-43a1-96e6-2ddac5ff1a38 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:17.031849 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-60e9c7f9-e59a-43a1-96e6-2ddac5ff1a38 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:17.171842 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-60e9c7f9-e59a-43a1-96e6-2ddac5ff1a38 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:17.180957 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-60e9c7f9-e59a-43a1-96e6-2ddac5ff1a38 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:17.182455 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-60e9c7f9-e59a-43a1-96e6-2ddac5ff1a38 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:17.183661 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-60e9c7f9-e59a-43a1-96e6-2ddac5ff1a38 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1716 microversion: 2.20 time: 0.166473 Sep 19 12:37:17.184229 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 453/910] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:17 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1716 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:37:33.247274 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=25 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:37:33.248107 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:37:33.440452 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-43d846cf-b010-4301-8fc0-fb33a69b92d2 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Action: 'create', calling method: .version_select at 0x7f54b3577700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1129654240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwiRoza1cWG7rHAw3zv7KDMluYaQHZEzfuvEJuU9E5HnuQF/9BR7lOM6cBKytbiAMrpyc5W0+N3xV4edEb05uq4dkQ7TUgTnEqRUuC49NQ4y4yfmm98po4i/Cughm6nOg=="}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:37:33.457843 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-43d846cf-b010-4301-8fc0-fb33a69b92d2 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Getting quotas for project ea2bd5c94eb7415c80a4e24452c08eb4. Resources: {'key_pairs'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:37:33.463329 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-43d846cf-b010-4301-8fc0-fb33a69b92d2 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Getting quotas for user 88b8a34360fa4595a07c7d3610563b77 and project ea2bd5c94eb7415c80a4e24452c08eb4. Resources: {'key_pairs'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:37:33.579422 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-43d846cf-b010-4301-8fc0-fb33a69b92d2 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.337353 Sep 19 12:37:33.580113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 458/911] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Sep 19 12:37:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:37:50.984058 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-763a42b3-4501-4ea1-ab90-4a10947eed06 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:50.986306 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-763a42b3-4501-4ea1-ab90-4a10947eed06 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:50.988384 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:37:50.989050 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=18 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:37:50.994315 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-763a42b3-4501-4ea1-ab90-4a10947eed06 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:50.994790 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-763a42b3-4501-4ea1-ab90-4a10947eed06 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:50.995219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-763a42b3-4501-4ea1-ab90-4a10947eed06 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:50.995898 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-763a42b3-4501-4ea1-ab90-4a10947eed06 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:50.996346 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-763a42b3-4501-4ea1-ab90-4a10947eed06 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:50.996798 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-763a42b3-4501-4ea1-ab90-4a10947eed06 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:51.026439 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-763a42b3-4501-4ea1-ab90-4a10947eed06 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046474 Sep 19 12:37:51.026984 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 454/912] 10.222.0.93 () {60 vars in 1343 bytes} [Mon Sep 19 12:37:50 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:37:51.095030 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=4 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:37:51.095732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:37:51.099602 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-ee142f4c-4d53-4ad6-879e-8dae088cafc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:51.100128 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ee142f4c-4d53-4ad6-879e-8dae088cafc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:51.106461 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ee142f4c-4d53-4ad6-879e-8dae088cafc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:51.106945 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ee142f4c-4d53-4ad6-879e-8dae088cafc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:51.108222 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ee142f4c-4d53-4ad6-879e-8dae088cafc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:51.108222 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ee142f4c-4d53-4ad6-879e-8dae088cafc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:51.108485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ee142f4c-4d53-4ad6-879e-8dae088cafc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:51.108934 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-ee142f4c-4d53-4ad6-879e-8dae088cafc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:51.135046 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-ee142f4c-4d53-4ad6-879e-8dae088cafc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Going to try to terminate instance {{(pid=121429) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:37:51.457934 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-ee142f4c-4d53-4ad6-879e-8dae088cafc8 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "DELETE /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 204 len: 0 microversion: 2.20 time: 0.363977 Sep 19 12:37:51.458473 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 459/913] 10.222.0.93 () {60 vars in 1280 bytes} [Mon Sep 19 12:37:51 2022] DELETE /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 12:37:51.468049 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-86d33c77-9d56-492a-8c46-0144d8c6c882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:51.468682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-86d33c77-9d56-492a-8c46-0144d8c6c882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:51.475571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-86d33c77-9d56-492a-8c46-0144d8c6c882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:51.479062 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-86d33c77-9d56-492a-8c46-0144d8c6c882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:51.479062 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-86d33c77-9d56-492a-8c46-0144d8c6c882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:51.479062 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-86d33c77-9d56-492a-8c46-0144d8c6c882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:51.479062 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-86d33c77-9d56-492a-8c46-0144d8c6c882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:51.479468 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-86d33c77-9d56-492a-8c46-0144d8c6c882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:51.607720 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-86d33c77-9d56-492a-8c46-0144d8c6c882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:51.615719 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-86d33c77-9d56-492a-8c46-0144d8c6c882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:51.617227 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-86d33c77-9d56-492a-8c46-0144d8c6c882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:51.618392 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-86d33c77-9d56-492a-8c46-0144d8c6c882 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1722 microversion: 2.20 time: 0.154891 Sep 19 12:37:51.618952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 455/914] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:51 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:37:52.644238 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9bc4e2b6-57b5-43b5-9755-1250a3746111 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:52.644952 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9bc4e2b6-57b5-43b5-9755-1250a3746111 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:52.651457 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9bc4e2b6-57b5-43b5-9755-1250a3746111 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:52.655217 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9bc4e2b6-57b5-43b5-9755-1250a3746111 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:52.655217 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9bc4e2b6-57b5-43b5-9755-1250a3746111 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:52.655217 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9bc4e2b6-57b5-43b5-9755-1250a3746111 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:52.655217 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9bc4e2b6-57b5-43b5-9755-1250a3746111 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:52.655770 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9bc4e2b6-57b5-43b5-9755-1250a3746111 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:52.793700 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9bc4e2b6-57b5-43b5-9755-1250a3746111 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:52.802051 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9bc4e2b6-57b5-43b5-9755-1250a3746111 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:52.803688 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9bc4e2b6-57b5-43b5-9755-1250a3746111 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:52.804875 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9bc4e2b6-57b5-43b5-9755-1250a3746111 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1722 microversion: 2.20 time: 0.165123 Sep 19 12:37:52.805453 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 460/915] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:52 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:37:53.085003 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d5be161a-2d8e-476c-85d2-7f45f5123616 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1661002675", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1129654240", "security_groups": [{"name": "tempest-secgroup-smoke-1134905487"}], "block_device_mapping_v2": [{"uuid": "7f17a61c-1978-4874-b43f-0177a09ddebb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e6b353e9-72f5-45ca-9fc7-16de881dafaf"}]}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:37:53.250130 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.network.neutron [None req-d5be161a-2d8e-476c-85d2-7f45f5123616 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] validate_networks() for [('e6b353e9-72f5-45ca-9fc7-16de881dafaf', None, None, None, None, None)] {{(pid=121428) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:37:53.831525 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-af244269-49d4-4c87-ac44-77dd83d66c20 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:53.832177 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-af244269-49d4-4c87-ac44-77dd83d66c20 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:53.839480 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-af244269-49d4-4c87-ac44-77dd83d66c20 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:53.840961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-af244269-49d4-4c87-ac44-77dd83d66c20 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:53.841548 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-af244269-49d4-4c87-ac44-77dd83d66c20 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:53.842726 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-af244269-49d4-4c87-ac44-77dd83d66c20 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:53.843283 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-af244269-49d4-4c87-ac44-77dd83d66c20 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:53.843381 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-af244269-49d4-4c87-ac44-77dd83d66c20 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:53.965773 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-af244269-49d4-4c87-ac44-77dd83d66c20 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:53.974240 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-af244269-49d4-4c87-ac44-77dd83d66c20 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:53.975384 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-af244269-49d4-4c87-ac44-77dd83d66c20 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:53.977110 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-af244269-49d4-4c87-ac44-77dd83d66c20 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1654 microversion: 2.20 time: 0.149068 Sep 19 12:37:53.978126 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 461/916] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:53 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1654 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:37:54.326319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-d5be161a-2d8e-476c-85d2-7f45f5123616 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Flavor limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:37:54.326809 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-d5be161a-2d8e-476c-85d2-7f45f5123616 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Image limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:37:54.327169 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-d5be161a-2d8e-476c-85d2-7f45f5123616 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Flavor pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:37:54.327567 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-d5be161a-2d8e-476c-85d2-7f45f5123616 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Image pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:37:54.327971 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-d5be161a-2d8e-476c-85d2-7f45f5123616 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:37:54.339645 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d5be161a-2d8e-476c-85d2-7f45f5123616 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:54.340415 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d5be161a-2d8e-476c-85d2-7f45f5123616 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:54.340892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d5be161a-2d8e-476c-85d2-7f45f5123616 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:54.341627 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d5be161a-2d8e-476c-85d2-7f45f5123616 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:54.342084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d5be161a-2d8e-476c-85d2-7f45f5123616 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:54.342498 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d5be161a-2d8e-476c-85d2-7f45f5123616 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:54.360714 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-d5be161a-2d8e-476c-85d2-7f45f5123616 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Getting quotas for project ea2bd5c94eb7415c80a4e24452c08eb4. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:37:54.364859 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-d5be161a-2d8e-476c-85d2-7f45f5123616 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Getting quotas for user 88b8a34360fa4595a07c7d3610563b77 and project ea2bd5c94eb7415c80a4e24452c08eb4. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:37:54.425439 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d5be161a-2d8e-476c-85d2-7f45f5123616 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Going to run 1 instances... {{(pid=121428) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:37:54.427754 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d5be161a-2d8e-476c-85d2-7f45f5123616 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f17a61c-1978-4874-b43f-0177a09ddebb',volume_size=None,volume_type=None)] {{(pid=121428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:37:54.577491 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-c6f0e35e-25a3-4373-a4ef-c58aff6f6142 req-bf7f4912-3e69-4138-b437-9ff26a5a3fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73260e21-141c-4941-bdbe-66ee0eeef141", "name": "network-vif-deleted", "tag": "3bbecd75-6878-45e6-92b1-03e016e3daab"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:37:54.591480 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-c6f0e35e-25a3-4373-a4ef-c58aff6f6142 req-bf7f4912-3e69-4138-b437-9ff26a5a3fb8 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:54.591939 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-c6f0e35e-25a3-4373-a4ef-c58aff6f6142 req-bf7f4912-3e69-4138-b437-9ff26a5a3fb8 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:54.592381 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-c6f0e35e-25a3-4373-a4ef-c58aff6f6142 req-bf7f4912-3e69-4138-b437-9ff26a5a3fb8 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:54.605768 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-c6f0e35e-25a3-4373-a4ef-c58aff6f6142 req-bf7f4912-3e69-4138-b437-9ff26a5a3fb8 service nova] Creating event network-vif-deleted:3bbecd75-6878-45e6-92b1-03e016e3daab for instance 73260e21-141c-4941-bdbe-66ee0eeef141 on hv-cinder-85061 Sep 19 12:37:54.611063 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-c6f0e35e-25a3-4373-a4ef-c58aff6f6142 req-bf7f4912-3e69-4138-b437-9ff26a5a3fb8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104062 Sep 19 12:37:54.611859 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 462/917] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:37:54.958641 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d5be161a-2d8e-476c-85d2-7f45f5123616 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.877242 Sep 19 12:37:54.959750 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 456/918] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:37:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:37:54.973677 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c29009a6-1f23-4948-be02-9377bc06e7a5 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:54.974495 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c29009a6-1f23-4948-be02-9377bc06e7a5 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:55.019281 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-5c7f82c7-4d5c-4a30-aa4a-ac84f4eef398 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:55.019900 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-5c7f82c7-4d5c-4a30-aa4a-ac84f4eef398 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:55.030960 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5c7f82c7-4d5c-4a30-aa4a-ac84f4eef398 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:55.031716 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5c7f82c7-4d5c-4a30-aa4a-ac84f4eef398 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:55.032586 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5c7f82c7-4d5c-4a30-aa4a-ac84f4eef398 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:55.033473 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5c7f82c7-4d5c-4a30-aa4a-ac84f4eef398 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:55.034098 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5c7f82c7-4d5c-4a30-aa4a-ac84f4eef398 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:55.034979 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5c7f82c7-4d5c-4a30-aa4a-ac84f4eef398 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:55.068928 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c29009a6-1f23-4948-be02-9377bc06e7a5 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:55.077114 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c29009a6-1f23-4948-be02-9377bc06e7a5 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1095 microversion: 2.1 time: 0.108816 Sep 19 12:37:55.089547 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 463/919] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:37:54 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1095 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:37:55.098573 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5c7f82c7-4d5c-4a30-aa4a-ac84f4eef398 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:55.099276 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5c7f82c7-4d5c-4a30-aa4a-ac84f4eef398 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:55.099846 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5c7f82c7-4d5c-4a30-aa4a-ac84f4eef398 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:55.100371 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-5c7f82c7-4d5c-4a30-aa4a-ac84f4eef398 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lazy-loading 'fault' on Instance uuid 73260e21-141c-4941-bdbe-66ee0eeef141 {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:37:55.160794 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5c7f82c7-4d5c-4a30-aa4a-ac84f4eef398 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:55.170564 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5c7f82c7-4d5c-4a30-aa4a-ac84f4eef398 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:55.173645 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5c7f82c7-4d5c-4a30-aa4a-ac84f4eef398 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6f743b2ff4246d98700f57efedfcea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6316917c9ff94be4bed47eb0b60e7f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:55.173645 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-5c7f82c7-4d5c-4a30-aa4a-ac84f4eef398 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 200 len: 1370 microversion: 2.20 time: 0.157985 Sep 19 12:37:55.177408 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 457/920] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:54 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:37:56.102662 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-174548dd-c1c3-4aa1-8aa5-79d59582d68c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:56.106925 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-174548dd-c1c3-4aa1-8aa5-79d59582d68c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:56.161737 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-174548dd-c1c3-4aa1-8aa5-79d59582d68c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:56.169619 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-174548dd-c1c3-4aa1-8aa5-79d59582d68c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1095 microversion: 2.1 time: 0.071826 Sep 19 12:37:56.170211 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 464/921] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:37:56 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:37:56.204674 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-89e42b65-2bc0-4531-acf6-9ab21b944007 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:56.205309 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-89e42b65-2bc0-4531-acf6-9ab21b944007 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:56.211797 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-89e42b65-2bc0-4531-acf6-9ab21b944007 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:56.213830 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-89e42b65-2bc0-4531-acf6-9ab21b944007 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:56.213830 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-89e42b65-2bc0-4531-acf6-9ab21b944007 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:56.213830 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-89e42b65-2bc0-4531-acf6-9ab21b944007 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:56.213830 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-89e42b65-2bc0-4531-acf6-9ab21b944007 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:56.214292 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-89e42b65-2bc0-4531-acf6-9ab21b944007 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:56.228511 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-89e42b65-2bc0-4531-acf6-9ab21b944007 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] HTTP exception thrown: Instance 73260e21-141c-4941-bdbe-66ee0eeef141 could not be found. Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-89e42b65-2bc0-4531-acf6-9ab21b944007 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Request method failure captured: Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 HTTP/1.1 Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKGFFQsmBjto4PE6FHYEIOW-f-Y0xL-ZgRHhS_DJYbN7UZMVOSUj-nR7xeJ56Tyr3xv-CyRMbA0kM5YTZh7ROrQNA5bHf6mt63iR5GPVljEWXD-oD-lOgYlSns4GueBMxiZyo59uPU9c5ns8gYCGRp2-pq9TVmYRpihvuBtUEV_M0CvE Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 6316917c9ff94be4bed47eb0b60e7f33 Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1443879091 Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:37:56.230195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:37:56.231984 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6316917c9ff94be4bed47eb0b60e7f33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6316917c9ff94be4bed47eb0b60e7f33", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6316917c9ff94be4bed47eb0b60e7f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6316917c9ff94be4bed47eb0b60e7f33"}]}] Sep 19 12:37:56.231984 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1443879091 Sep 19 12:37:56.231984 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 6316917c9ff94be4bed47eb0b60e7f33 Sep 19 12:37:56.231984 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1443879091 Sep 19 12:37:56.231984 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-AttachVolumeShelveTestJSON-1443879091-project Sep 19 12:37:56.231984 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:37:56.231984 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:37:56.231984 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: c6f743b2ff4246d98700f57efedfcea2 Sep 19 12:37:56.231984 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1443879091-project Sep 19 12:37:56.231984 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:37:56.231984 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance 73260e21-141c-4941-bdbe-66ee0eeef141 could not be found. Sep 19 12:37:56.231984 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': '73260e21-141c-4941-bdbe-66ee0eeef141'} Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73260e21-141c-4941-bdbe-66ee0eeef141 could not be found. Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:37:56.232981 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:37:56.234446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:37:56.234446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:37:56.234446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:37:56.234446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:37:56.234446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:37:56.234446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:37:56.234446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:37:56.234446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73260e21-141c-4941-bdbe-66ee0eeef141 could not be found. Sep 19 12:37:56.234446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:37:56.234446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:37:56.234446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:37:56.234446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:37:56.234446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:37:56.234446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:37:56.234446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:37:56.234446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:37:56.234446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73260e21-141c-4941-bdbe-66ee0eeef141 could not be found. Sep 19 12:37:56.234446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:37:56.235653 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-89e42b65-2bc0-4531-acf6-9ab21b944007 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Returning 404 to user: Instance 73260e21-141c-4941-bdbe-66ee0eeef141 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:37:56.235653 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-89e42b65-2bc0-4531-acf6-9ab21b944007 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 404 len: 111 microversion: 2.20 time: 0.031866 Sep 19 12:37:56.235653 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 458/922] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:56 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:37:56.241546 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-48f6e754-4ab5-42bf-a10e-7136aba47e0e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '.version_select at 0x7f54b339c040>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:56.332832 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-48f6e754-4ab5-42bf-a10e-7136aba47e0e tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-575871374" status: 204 len: 0 microversion: 2.20 time: 0.095201 Sep 19 12:37:56.333413 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 465/923] 10.222.0.93 () {60 vars in 1259 bytes} [Mon Sep 19 12:37:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-575871374 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 12:37:57.193161 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-7775511e-374e-475d-a478-316d58e06aa4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:57.193685 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-7775511e-374e-475d-a478-316d58e06aa4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:57.200672 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7775511e-374e-475d-a478-316d58e06aa4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:57.201157 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7775511e-374e-475d-a478-316d58e06aa4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:57.201589 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7775511e-374e-475d-a478-316d58e06aa4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:57.202283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7775511e-374e-475d-a478-316d58e06aa4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:57.202735 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7775511e-374e-475d-a478-316d58e06aa4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:57.203156 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7775511e-374e-475d-a478-316d58e06aa4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:57.267443 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-7775511e-374e-475d-a478-316d58e06aa4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:57.275400 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-7775511e-374e-475d-a478-316d58e06aa4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1193 microversion: 2.1 time: 0.086297 Sep 19 12:37:57.275987 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 459/924] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:37:57 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:37:58.298383 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4d050b73-eb88-4d97-a38c-847a55a3f86d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:58.299002 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4d050b73-eb88-4d97-a38c-847a55a3f86d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:58.305886 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4d050b73-eb88-4d97-a38c-847a55a3f86d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:58.306377 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4d050b73-eb88-4d97-a38c-847a55a3f86d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:58.306814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4d050b73-eb88-4d97-a38c-847a55a3f86d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:58.307516 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4d050b73-eb88-4d97-a38c-847a55a3f86d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:58.307978 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4d050b73-eb88-4d97-a38c-847a55a3f86d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:58.308394 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4d050b73-eb88-4d97-a38c-847a55a3f86d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:58.371974 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-4d050b73-eb88-4d97-a38c-847a55a3f86d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:58.380310 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4d050b73-eb88-4d97-a38c-847a55a3f86d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1211 microversion: 2.1 time: 0.085908 Sep 19 12:37:58.381058 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 466/925] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:37:58 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:37:58.383944 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-336d7aad-4aad-4ffc-82dc-2d59d790e9c3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:58.384476 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-336d7aad-4aad-4ffc-82dc-2d59d790e9c3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:58.390957 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-336d7aad-4aad-4ffc-82dc-2d59d790e9c3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:58.391446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-336d7aad-4aad-4ffc-82dc-2d59d790e9c3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:58.391896 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-336d7aad-4aad-4ffc-82dc-2d59d790e9c3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:58.392684 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-336d7aad-4aad-4ffc-82dc-2d59d790e9c3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:58.393139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-336d7aad-4aad-4ffc-82dc-2d59d790e9c3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:58.393572 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-336d7aad-4aad-4ffc-82dc-2d59d790e9c3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:58.408113 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-336d7aad-4aad-4ffc-82dc-2d59d790e9c3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] HTTP exception thrown: Instance 73260e21-141c-4941-bdbe-66ee0eeef141 could not be found. Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-336d7aad-4aad-4ffc-82dc-2d59d790e9c3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Request method failure captured: Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: DELETE /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 HTTP/1.1 Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKGFFQsmBjto4PE6FHYEIOW-f-Y0xL-ZgRHhS_DJYbN7UZMVOSUj-nR7xeJ56Tyr3xv-CyRMbA0kM5YTZh7ROrQNA5bHf6mt63iR5GPVljEWXD-oD-lOgYlSns4GueBMxiZyo59uPU9c5ns8gYCGRp2-pq9TVmYRpihvuBtUEV_M0CvE Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 6316917c9ff94be4bed47eb0b60e7f33 Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1443879091 Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:37:58.414103 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:37:58.415743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6316917c9ff94be4bed47eb0b60e7f33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6316917c9ff94be4bed47eb0b60e7f33", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6316917c9ff94be4bed47eb0b60e7f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6316917c9ff94be4bed47eb0b60e7f33"}]}] Sep 19 12:37:58.415743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1443879091 Sep 19 12:37:58.415743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 6316917c9ff94be4bed47eb0b60e7f33 Sep 19 12:37:58.415743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1443879091 Sep 19 12:37:58.415743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-AttachVolumeShelveTestJSON-1443879091-project Sep 19 12:37:58.415743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:37:58.415743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:37:58.415743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: c6f743b2ff4246d98700f57efedfcea2 Sep 19 12:37:58.415743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1443879091-project Sep 19 12:37:58.415743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:37:58.415743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance 73260e21-141c-4941-bdbe-66ee0eeef141 could not be found. Sep 19 12:37:58.415743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': '73260e21-141c-4941-bdbe-66ee0eeef141'} Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73260e21-141c-4941-bdbe-66ee0eeef141 could not be found. Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:37:58.416519 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73260e21-141c-4941-bdbe-66ee0eeef141 could not be found. Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73260e21-141c-4941-bdbe-66ee0eeef141 could not be found. Sep 19 12:37:58.418667 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:37:58.421043 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-336d7aad-4aad-4ffc-82dc-2d59d790e9c3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Returning 404 to user: Instance 73260e21-141c-4941-bdbe-66ee0eeef141 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:37:58.421043 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-336d7aad-4aad-4ffc-82dc-2d59d790e9c3 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "DELETE /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 404 len: 111 microversion: 2.20 time: 0.031909 Sep 19 12:37:58.421043 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 460/926] 10.222.0.93 () {60 vars in 1280 bytes} [Mon Sep 19 12:37:58 2022] DELETE /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 19 12:37:58.421539 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-db003324-3c4c-44dc-939e-3d43a8549525 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:58.421820 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-db003324-3c4c-44dc-939e-3d43a8549525 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 73260e21-141c-4941-bdbe-66ee0eeef141] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:58.427827 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-db003324-3c4c-44dc-939e-3d43a8549525 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:58.428323 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-db003324-3c4c-44dc-939e-3d43a8549525 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:58.428783 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-db003324-3c4c-44dc-939e-3d43a8549525 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:58.429514 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-db003324-3c4c-44dc-939e-3d43a8549525 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:58.429969 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-db003324-3c4c-44dc-939e-3d43a8549525 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:58.430397 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-db003324-3c4c-44dc-939e-3d43a8549525 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:58.444026 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-db003324-3c4c-44dc-939e-3d43a8549525 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] HTTP exception thrown: Instance 73260e21-141c-4941-bdbe-66ee0eeef141 could not be found. Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-db003324-3c4c-44dc-939e-3d43a8549525 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Request method failure captured: Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 HTTP/1.1 Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKGFFQsmBjto4PE6FHYEIOW-f-Y0xL-ZgRHhS_DJYbN7UZMVOSUj-nR7xeJ56Tyr3xv-CyRMbA0kM5YTZh7ROrQNA5bHf6mt63iR5GPVljEWXD-oD-lOgYlSns4GueBMxiZyo59uPU9c5ns8gYCGRp2-pq9TVmYRpihvuBtUEV_M0CvE Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 6316917c9ff94be4bed47eb0b60e7f33 Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1443879091 Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:37:58.446406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:37:58.447916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6316917c9ff94be4bed47eb0b60e7f33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6316917c9ff94be4bed47eb0b60e7f33", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6316917c9ff94be4bed47eb0b60e7f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6316917c9ff94be4bed47eb0b60e7f33"}]}] Sep 19 12:37:58.447916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1443879091 Sep 19 12:37:58.447916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 6316917c9ff94be4bed47eb0b60e7f33 Sep 19 12:37:58.447916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1443879091 Sep 19 12:37:58.447916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-AttachVolumeShelveTestJSON-1443879091-project Sep 19 12:37:58.447916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:37:58.447916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:37:58.447916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: c6f743b2ff4246d98700f57efedfcea2 Sep 19 12:37:58.447916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1443879091-project Sep 19 12:37:58.447916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:37:58.447916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance 73260e21-141c-4941-bdbe-66ee0eeef141 could not be found. Sep 19 12:37:58.447916 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': '73260e21-141c-4941-bdbe-66ee0eeef141'} Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73260e21-141c-4941-bdbe-66ee0eeef141 could not be found. Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:37:58.448720 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:37:58.450451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:37:58.450451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:37:58.450451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:37:58.450451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:37:58.450451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:37:58.450451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:37:58.450451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:37:58.450451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73260e21-141c-4941-bdbe-66ee0eeef141 could not be found. Sep 19 12:37:58.450451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:37:58.450451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:37:58.450451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:37:58.450451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:37:58.450451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:37:58.450451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:37:58.450451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:37:58.450451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:37:58.450451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73260e21-141c-4941-bdbe-66ee0eeef141 could not be found. Sep 19 12:37:58.450451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:37:58.451611 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-db003324-3c4c-44dc-939e-3d43a8549525 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Returning 404 to user: Instance 73260e21-141c-4941-bdbe-66ee0eeef141 could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:37:58.451611 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-db003324-3c4c-44dc-939e-3d43a8549525 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141" status: 404 len: 111 microversion: 2.20 time: 0.030580 Sep 19 12:37:58.451611 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 467/927] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:58 2022] GET /compute/v2.1/servers/73260e21-141c-4941-bdbe-66ee0eeef141 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:37:59.403440 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-bfafd75c-9325-4d67-9cdb-c2c67ad6538a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:59.404055 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-bfafd75c-9325-4d67-9cdb-c2c67ad6538a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:59.410561 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bfafd75c-9325-4d67-9cdb-c2c67ad6538a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:59.425491 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bfafd75c-9325-4d67-9cdb-c2c67ad6538a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:59.425491 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bfafd75c-9325-4d67-9cdb-c2c67ad6538a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:59.425491 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bfafd75c-9325-4d67-9cdb-c2c67ad6538a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:59.425491 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bfafd75c-9325-4d67-9cdb-c2c67ad6538a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:59.425915 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bfafd75c-9325-4d67-9cdb-c2c67ad6538a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:59.539461 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-9b5263de-f4b1-4797-8afe-148ed1f1ba24 req-d97a20bf-28fe-4aa2-9e6d-97daf5951a74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e74d99e-308c-42c2-b0e4-41a594c0db6a", "tag": "ab201db2-b696-4cee-915b-c71cf380b91d"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:37:59.550115 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-9b5263de-f4b1-4797-8afe-148ed1f1ba24 req-d97a20bf-28fe-4aa2-9e6d-97daf5951a74 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:59.550617 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-9b5263de-f4b1-4797-8afe-148ed1f1ba24 req-d97a20bf-28fe-4aa2-9e6d-97daf5951a74 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:59.551113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-9b5263de-f4b1-4797-8afe-148ed1f1ba24 req-d97a20bf-28fe-4aa2-9e6d-97daf5951a74 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:59.562580 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-9b5263de-f4b1-4797-8afe-148ed1f1ba24 req-d97a20bf-28fe-4aa2-9e6d-97daf5951a74 service nova] Creating event network-changed:ab201db2-b696-4cee-915b-c71cf380b91d for instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a on hv-cinder-85061 Sep 19 12:37:59.567647 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-9b5263de-f4b1-4797-8afe-148ed1f1ba24 req-d97a20bf-28fe-4aa2-9e6d-97daf5951a74 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032833 Sep 19 12:37:59.568327 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 468/928] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:37:59.603972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-bfafd75c-9325-4d67-9cdb-c2c67ad6538a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:59.609708 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-bfafd75c-9325-4d67-9cdb-c2c67ad6538a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1267 microversion: 2.1 time: 0.210094 Sep 19 12:37:59.610431 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 461/929] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:37:59 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:37:59.784698 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-df3be128-2590-49df-8e2e-2a56faeb0ecf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:59.785312 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-df3be128-2590-49df-8e2e-2a56faeb0ecf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:59.792107 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-df3be128-2590-49df-8e2e-2a56faeb0ecf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:59.792623 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-df3be128-2590-49df-8e2e-2a56faeb0ecf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:59.793058 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-df3be128-2590-49df-8e2e-2a56faeb0ecf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:59.793754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-df3be128-2590-49df-8e2e-2a56faeb0ecf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:59.794277 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-df3be128-2590-49df-8e2e-2a56faeb0ecf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:59.794704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-df3be128-2590-49df-8e2e-2a56faeb0ecf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:59.808495 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-df3be128-2590-49df-8e2e-2a56faeb0ecf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] HTTP exception thrown: Instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 could not be found. Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-df3be128-2590-49df-8e2e-2a56faeb0ecf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Request method failure captured: Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: DELETE /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 HTTP/1.1 Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKGFFQsmBjto4PE6FHYEIOW-f-Y0xL-ZgRHhS_DJYbN7UZMVOSUj-nR7xeJ56Tyr3xv-CyRMbA0kM5YTZh7ROrQNA5bHf6mt63iR5GPVljEWXD-oD-lOgYlSns4GueBMxiZyo59uPU9c5ns8gYCGRp2-pq9TVmYRpihvuBtUEV_M0CvE Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 6316917c9ff94be4bed47eb0b60e7f33 Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1443879091 Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:37:59.810204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:37:59.811754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6316917c9ff94be4bed47eb0b60e7f33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6316917c9ff94be4bed47eb0b60e7f33", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6316917c9ff94be4bed47eb0b60e7f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6316917c9ff94be4bed47eb0b60e7f33"}]}] Sep 19 12:37:59.811754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1443879091 Sep 19 12:37:59.811754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 6316917c9ff94be4bed47eb0b60e7f33 Sep 19 12:37:59.811754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1443879091 Sep 19 12:37:59.811754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-AttachVolumeShelveTestJSON-1443879091-project Sep 19 12:37:59.811754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:37:59.811754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:37:59.811754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: c6f743b2ff4246d98700f57efedfcea2 Sep 19 12:37:59.811754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1443879091-project Sep 19 12:37:59.811754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:37:59.811754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 could not be found. Sep 19 12:37:59.811754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': '7c5331a8-de67-49e9-a0f6-96c8a1915492'} Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 could not be found. Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:37:59.813049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 could not be found. Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 could not be found. Sep 19 12:37:59.814665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:37:59.816683 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-df3be128-2590-49df-8e2e-2a56faeb0ecf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Returning 404 to user: Instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:37:59.816683 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-df3be128-2590-49df-8e2e-2a56faeb0ecf tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 404 len: 111 microversion: 2.20 time: 0.031467 Sep 19 12:37:59.816683 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 469/930] 10.222.0.93 () {60 vars in 1280 bytes} [Mon Sep 19 12:37:59 2022] DELETE /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:37:59.820807 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-cb5c158c-c9fd-40d2-bdf1-0f6bf0385557 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:59.821419 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-cb5c158c-c9fd-40d2-bdf1-0f6bf0385557 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] [instance: 7c5331a8-de67-49e9-a0f6-96c8a1915492] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:59.827439 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cb5c158c-c9fd-40d2-bdf1-0f6bf0385557 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:59.827916 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cb5c158c-c9fd-40d2-bdf1-0f6bf0385557 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:59.828592 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cb5c158c-c9fd-40d2-bdf1-0f6bf0385557 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:59.829573 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cb5c158c-c9fd-40d2-bdf1-0f6bf0385557 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:59.830105 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cb5c158c-c9fd-40d2-bdf1-0f6bf0385557 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:59.830444 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cb5c158c-c9fd-40d2-bdf1-0f6bf0385557 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:59.845202 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-cb5c158c-c9fd-40d2-bdf1-0f6bf0385557 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] HTTP exception thrown: Instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 could not be found. Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-cb5c158c-c9fd-40d2-bdf1-0f6bf0385557 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Request method failure captured: Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 HTTP/1.1 Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKGFFQsmBjto4PE6FHYEIOW-f-Y0xL-ZgRHhS_DJYbN7UZMVOSUj-nR7xeJ56Tyr3xv-CyRMbA0kM5YTZh7ROrQNA5bHf6mt63iR5GPVljEWXD-oD-lOgYlSns4GueBMxiZyo59uPU9c5ns8gYCGRp2-pq9TVmYRpihvuBtUEV_M0CvE Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 6316917c9ff94be4bed47eb0b60e7f33 Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1443879091 Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:37:59.846771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:37:59.848380 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6316917c9ff94be4bed47eb0b60e7f33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6316917c9ff94be4bed47eb0b60e7f33", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6316917c9ff94be4bed47eb0b60e7f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6316917c9ff94be4bed47eb0b60e7f33"}]}] Sep 19 12:37:59.848380 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1443879091 Sep 19 12:37:59.848380 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 6316917c9ff94be4bed47eb0b60e7f33 Sep 19 12:37:59.848380 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1443879091 Sep 19 12:37:59.848380 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-AttachVolumeShelveTestJSON-1443879091-project Sep 19 12:37:59.848380 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:37:59.848380 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:37:59.848380 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: c6f743b2ff4246d98700f57efedfcea2 Sep 19 12:37:59.848380 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1443879091-project Sep 19 12:37:59.848380 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:37:59.848380 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 could not be found. Sep 19 12:37:59.848380 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': '7c5331a8-de67-49e9-a0f6-96c8a1915492'} Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 could not be found. Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:37:59.849598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:37:59.851805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:37:59.851805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:37:59.851805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:37:59.851805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:37:59.851805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:37:59.851805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:37:59.851805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:37:59.851805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 could not be found. Sep 19 12:37:59.851805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:37:59.851805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:37:59.851805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:37:59.851805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:37:59.851805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:37:59.851805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:37:59.851805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:37:59.851805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:37:59.851805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 could not be found. Sep 19 12:37:59.851805 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:37:59.853214 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-cb5c158c-c9fd-40d2-bdf1-0f6bf0385557 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] Returning 404 to user: Instance 7c5331a8-de67-49e9-a0f6-96c8a1915492 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:37:59.853214 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-cb5c158c-c9fd-40d2-bdf1-0f6bf0385557 tempest-AttachVolumeShelveTestJSON-1443879091 tempest-AttachVolumeShelveTestJSON-1443879091-project] 10.222.0.93 "GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492" status: 404 len: 111 microversion: 2.20 time: 0.031468 Sep 19 12:37:59.863984 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 462/931] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Sep 19 12:37:59 2022] GET /compute/v2.1/servers/7c5331a8-de67-49e9-a0f6-96c8a1915492 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:38:00.636054 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-fd10f078-b53d-439e-94f0-c1816aa6c948 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:00.637018 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-fd10f078-b53d-439e-94f0-c1816aa6c948 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:00.643972 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fd10f078-b53d-439e-94f0-c1816aa6c948 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:00.644440 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fd10f078-b53d-439e-94f0-c1816aa6c948 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:00.644917 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fd10f078-b53d-439e-94f0-c1816aa6c948 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:00.645625 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fd10f078-b53d-439e-94f0-c1816aa6c948 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:00.646076 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fd10f078-b53d-439e-94f0-c1816aa6c948 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:00.646501 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fd10f078-b53d-439e-94f0-c1816aa6c948 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:00.790693 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-fd10f078-b53d-439e-94f0-c1816aa6c948 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:00.799617 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-fd10f078-b53d-439e-94f0-c1816aa6c948 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1267 microversion: 2.1 time: 0.167719 Sep 19 12:38:00.800224 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 470/932] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:00 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:01.823771 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-7a8ecdb9-43bf-42d7-9e9a-13e8f2e6df43 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:01.824884 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-7a8ecdb9-43bf-42d7-9e9a-13e8f2e6df43 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:01.832965 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7a8ecdb9-43bf-42d7-9e9a-13e8f2e6df43 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:01.838644 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7a8ecdb9-43bf-42d7-9e9a-13e8f2e6df43 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:01.838644 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7a8ecdb9-43bf-42d7-9e9a-13e8f2e6df43 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:01.838644 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7a8ecdb9-43bf-42d7-9e9a-13e8f2e6df43 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:01.838644 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7a8ecdb9-43bf-42d7-9e9a-13e8f2e6df43 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:01.838988 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7a8ecdb9-43bf-42d7-9e9a-13e8f2e6df43 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:01.982816 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-7a8ecdb9-43bf-42d7-9e9a-13e8f2e6df43 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:01.992345 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-7a8ecdb9-43bf-42d7-9e9a-13e8f2e6df43 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1267 microversion: 2.1 time: 0.172743 Sep 19 12:38:01.992964 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 463/933] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:01 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:03.019231 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c1b406a9-83ac-40b7-888e-be6d8f210eb0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:03.019938 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c1b406a9-83ac-40b7-888e-be6d8f210eb0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:03.029517 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1b406a9-83ac-40b7-888e-be6d8f210eb0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:03.030484 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1b406a9-83ac-40b7-888e-be6d8f210eb0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:03.031170 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1b406a9-83ac-40b7-888e-be6d8f210eb0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:03.032409 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1b406a9-83ac-40b7-888e-be6d8f210eb0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:03.033183 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1b406a9-83ac-40b7-888e-be6d8f210eb0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:03.033918 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1b406a9-83ac-40b7-888e-be6d8f210eb0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:03.191655 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c1b406a9-83ac-40b7-888e-be6d8f210eb0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:03.208341 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c1b406a9-83ac-40b7-888e-be6d8f210eb0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1267 microversion: 2.1 time: 0.196636 Sep 19 12:38:03.208969 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 471/934] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:03 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:04.234291 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-20f2c615-72a1-4a0b-adca-e1097330177e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:04.235021 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-20f2c615-72a1-4a0b-adca-e1097330177e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:04.241694 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-20f2c615-72a1-4a0b-adca-e1097330177e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:04.242183 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-20f2c615-72a1-4a0b-adca-e1097330177e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:04.242616 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-20f2c615-72a1-4a0b-adca-e1097330177e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:04.243317 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-20f2c615-72a1-4a0b-adca-e1097330177e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:04.243773 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-20f2c615-72a1-4a0b-adca-e1097330177e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:04.244194 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-20f2c615-72a1-4a0b-adca-e1097330177e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:04.350716 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=2 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:38:04.372253 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=6 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:38:04.397869 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-20f2c615-72a1-4a0b-adca-e1097330177e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:04.409676 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-20f2c615-72a1-4a0b-adca-e1097330177e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1267 microversion: 2.1 time: 0.179214 Sep 19 12:38:04.423774 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 464/935] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:04 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:05.433589 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-98d9c243-ac12-47cd-af4e-9ec63d76c26e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:05.434207 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-98d9c243-ac12-47cd-af4e-9ec63d76c26e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:05.440924 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-98d9c243-ac12-47cd-af4e-9ec63d76c26e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:05.441416 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-98d9c243-ac12-47cd-af4e-9ec63d76c26e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:05.441852 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-98d9c243-ac12-47cd-af4e-9ec63d76c26e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:05.442566 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-98d9c243-ac12-47cd-af4e-9ec63d76c26e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:05.443020 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-98d9c243-ac12-47cd-af4e-9ec63d76c26e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:05.443446 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-98d9c243-ac12-47cd-af4e-9ec63d76c26e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:05.587545 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-98d9c243-ac12-47cd-af4e-9ec63d76c26e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:05.596279 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-98d9c243-ac12-47cd-af4e-9ec63d76c26e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1267 microversion: 2.1 time: 0.166546 Sep 19 12:38:05.596920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 472/936] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:05 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:06.620179 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d20d54ad-f5e9-4318-8e88-15d4b0a8b7b4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:06.620798 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d20d54ad-f5e9-4318-8e88-15d4b0a8b7b4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:06.627098 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d20d54ad-f5e9-4318-8e88-15d4b0a8b7b4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:06.627834 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d20d54ad-f5e9-4318-8e88-15d4b0a8b7b4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:06.628479 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d20d54ad-f5e9-4318-8e88-15d4b0a8b7b4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:06.629256 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d20d54ad-f5e9-4318-8e88-15d4b0a8b7b4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:06.629710 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d20d54ad-f5e9-4318-8e88-15d4b0a8b7b4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:06.637713 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d20d54ad-f5e9-4318-8e88-15d4b0a8b7b4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:06.763386 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-d20d54ad-f5e9-4318-8e88-15d4b0a8b7b4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:06.771147 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d20d54ad-f5e9-4318-8e88-15d4b0a8b7b4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1267 microversion: 2.1 time: 0.155278 Sep 19 12:38:06.771724 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 465/937] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:06 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:07.794938 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-71882b52-0de5-49f0-96bd-bf492fc29e39 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:07.795558 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-71882b52-0de5-49f0-96bd-bf492fc29e39 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:07.797505 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=4 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:38:07.802874 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-71882b52-0de5-49f0-96bd-bf492fc29e39 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:07.803495 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-71882b52-0de5-49f0-96bd-bf492fc29e39 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:07.804023 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-71882b52-0de5-49f0-96bd-bf492fc29e39 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:07.804648 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-71882b52-0de5-49f0-96bd-bf492fc29e39 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:07.805100 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-71882b52-0de5-49f0-96bd-bf492fc29e39 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:07.805527 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-71882b52-0de5-49f0-96bd-bf492fc29e39 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:07.948009 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-71882b52-0de5-49f0-96bd-bf492fc29e39 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:07.955881 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-71882b52-0de5-49f0-96bd-bf492fc29e39 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1267 microversion: 2.1 time: 0.164857 Sep 19 12:38:07.956447 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 473/938] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:07 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:08.979818 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-68daabd0-7036-4505-93f2-4d71d22b5829 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:08.980528 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-68daabd0-7036-4505-93f2-4d71d22b5829 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:08.987044 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-68daabd0-7036-4505-93f2-4d71d22b5829 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:08.987523 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-68daabd0-7036-4505-93f2-4d71d22b5829 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:08.987962 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-68daabd0-7036-4505-93f2-4d71d22b5829 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:08.988686 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-68daabd0-7036-4505-93f2-4d71d22b5829 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:08.989142 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-68daabd0-7036-4505-93f2-4d71d22b5829 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:08.989568 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-68daabd0-7036-4505-93f2-4d71d22b5829 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:09.139985 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-68daabd0-7036-4505-93f2-4d71d22b5829 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:09.158945 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-68daabd0-7036-4505-93f2-4d71d22b5829 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1267 microversion: 2.1 time: 0.183259 Sep 19 12:38:09.159884 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 466/939] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:08 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:10.183732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-a2247d79-ccf6-4eb1-9e4a-c2f3122aa94c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:10.184302 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-a2247d79-ccf6-4eb1-9e4a-c2f3122aa94c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:10.190983 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a2247d79-ccf6-4eb1-9e4a-c2f3122aa94c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:10.191477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a2247d79-ccf6-4eb1-9e4a-c2f3122aa94c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:10.191917 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a2247d79-ccf6-4eb1-9e4a-c2f3122aa94c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:10.192636 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a2247d79-ccf6-4eb1-9e4a-c2f3122aa94c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:10.193091 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a2247d79-ccf6-4eb1-9e4a-c2f3122aa94c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:10.193513 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a2247d79-ccf6-4eb1-9e4a-c2f3122aa94c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:10.333030 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-a2247d79-ccf6-4eb1-9e4a-c2f3122aa94c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:10.339049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-a2247d79-ccf6-4eb1-9e4a-c2f3122aa94c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1267 microversion: 2.1 time: 0.160128 Sep 19 12:38:10.339653 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 474/940] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:10 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:11.362371 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-f5b72de6-d1a1-435a-9e86-253042406779 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:11.363287 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-f5b72de6-d1a1-435a-9e86-253042406779 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:11.369883 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f5b72de6-d1a1-435a-9e86-253042406779 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:11.375186 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f5b72de6-d1a1-435a-9e86-253042406779 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:11.375186 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f5b72de6-d1a1-435a-9e86-253042406779 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:11.375186 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f5b72de6-d1a1-435a-9e86-253042406779 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:11.375186 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f5b72de6-d1a1-435a-9e86-253042406779 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:11.375616 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f5b72de6-d1a1-435a-9e86-253042406779 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:11.399153 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-b5364f39-43e3-413c-9c0f-dc98b4c19cde req-f3461b55-4e99-4b78-bed3-d583591aae93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e74d99e-308c-42c2-b0e4-41a594c0db6a", "name": "network-vif-plugged", "status": "completed", "tag": "ab201db2-b696-4cee-915b-c71cf380b91d"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:38:11.413054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-b5364f39-43e3-413c-9c0f-dc98b4c19cde req-f3461b55-4e99-4b78-bed3-d583591aae93 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:11.414158 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-b5364f39-43e3-413c-9c0f-dc98b4c19cde req-f3461b55-4e99-4b78-bed3-d583591aae93 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:11.414753 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-b5364f39-43e3-413c-9c0f-dc98b4c19cde req-f3461b55-4e99-4b78-bed3-d583591aae93 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:11.427021 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-b5364f39-43e3-413c-9c0f-dc98b4c19cde req-f3461b55-4e99-4b78-bed3-d583591aae93 service nova] Creating event network-vif-plugged:ab201db2-b696-4cee-915b-c71cf380b91d for instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a on hv-cinder-85061 Sep 19 12:38:11.434344 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-b5364f39-43e3-413c-9c0f-dc98b4c19cde req-f3461b55-4e99-4b78-bed3-d583591aae93 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166890 Sep 19 12:38:11.437006 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 467/941] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:38:11.526015 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-f5b72de6-d1a1-435a-9e86-253042406779 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:11.533905 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-f5b72de6-d1a1-435a-9e86-253042406779 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1267 microversion: 2.1 time: 0.175558 Sep 19 12:38:11.534482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 475/942] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:11 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:38:12.557468 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-af2bf03c-7afa-4d13-9794-e0d14a7f0629 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:12.558158 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-af2bf03c-7afa-4d13-9794-e0d14a7f0629 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:12.565688 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-af2bf03c-7afa-4d13-9794-e0d14a7f0629 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:12.566168 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-af2bf03c-7afa-4d13-9794-e0d14a7f0629 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:12.566599 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-af2bf03c-7afa-4d13-9794-e0d14a7f0629 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:12.567289 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-af2bf03c-7afa-4d13-9794-e0d14a7f0629 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:12.568006 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-af2bf03c-7afa-4d13-9794-e0d14a7f0629 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:12.568429 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-af2bf03c-7afa-4d13-9794-e0d14a7f0629 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:12.700155 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-af2bf03c-7afa-4d13-9794-e0d14a7f0629 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:12.708043 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-af2bf03c-7afa-4d13-9794-e0d14a7f0629 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1267 microversion: 2.1 time: 0.154820 Sep 19 12:38:12.708630 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 468/943] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:12 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:13.731866 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-83943426-0366-4ff7-9c2f-a1c7160283e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:13.732472 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-83943426-0366-4ff7-9c2f-a1c7160283e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:13.739015 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-83943426-0366-4ff7-9c2f-a1c7160283e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:13.739483 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-83943426-0366-4ff7-9c2f-a1c7160283e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:13.739917 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-83943426-0366-4ff7-9c2f-a1c7160283e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:13.740696 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-83943426-0366-4ff7-9c2f-a1c7160283e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:13.741148 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-83943426-0366-4ff7-9c2f-a1c7160283e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:13.741571 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-83943426-0366-4ff7-9c2f-a1c7160283e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:13.877461 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-83943426-0366-4ff7-9c2f-a1c7160283e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:13.887403 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-83943426-0366-4ff7-9c2f-a1c7160283e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1454 microversion: 2.1 time: 0.159381 Sep 19 12:38:13.887998 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 476/944] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:13 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:38:13.910326 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d25af9e8-85e1-464b-88e4-56726a72d0a1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:13.910939 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d25af9e8-85e1-464b-88e4-56726a72d0a1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:13.918235 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d25af9e8-85e1-464b-88e4-56726a72d0a1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:13.918644 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d25af9e8-85e1-464b-88e4-56726a72d0a1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:13.919082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d25af9e8-85e1-464b-88e4-56726a72d0a1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:13.919779 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d25af9e8-85e1-464b-88e4-56726a72d0a1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:13.920352 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d25af9e8-85e1-464b-88e4-56726a72d0a1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:13.920820 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d25af9e8-85e1-464b-88e4-56726a72d0a1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:14.061187 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-d25af9e8-85e1-464b-88e4-56726a72d0a1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:14.069144 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d25af9e8-85e1-464b-88e4-56726a72d0a1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1454 microversion: 2.1 time: 0.162854 Sep 19 12:38:14.072836 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 469/945] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:13 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:16.443526 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-3c1a2d2d-a926-4904-8d14-277176c63422 req-d6562a84-425d-42ee-84fa-6dd078f185c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e74d99e-308c-42c2-b0e4-41a594c0db6a", "tag": "ab201db2-b696-4cee-915b-c71cf380b91d"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:38:16.453769 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-3c1a2d2d-a926-4904-8d14-277176c63422 req-d6562a84-425d-42ee-84fa-6dd078f185c2 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:16.454250 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-3c1a2d2d-a926-4904-8d14-277176c63422 req-d6562a84-425d-42ee-84fa-6dd078f185c2 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:16.454694 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-3c1a2d2d-a926-4904-8d14-277176c63422 req-d6562a84-425d-42ee-84fa-6dd078f185c2 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:16.466306 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-3c1a2d2d-a926-4904-8d14-277176c63422 req-d6562a84-425d-42ee-84fa-6dd078f185c2 service nova] Creating event network-changed:ab201db2-b696-4cee-915b-c71cf380b91d for instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a on hv-cinder-85061 Sep 19 12:38:16.471419 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-3c1a2d2d-a926-4904-8d14-277176c63422 req-d6562a84-425d-42ee-84fa-6dd078f185c2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031626 Sep 19 12:38:16.472021 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 477/946] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:38:39.892622 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-6b1e8ff6-df69-475c-853d-888d0e583fe2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1151814942", "imageRef": "d4301833-8e96-46bf-a940-692f93f7fdba", "flavorRef": "452", "networks": [{"uuid": "6f4781da-a0dc-4d72-b7f3-ed072b6cdb61"}]}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:38:39.901541 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:38:39.901704 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Mon Sep 19 12:38:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.93) !!! Sep 19 12:38:39.903556 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:38:39.904430 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=78 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:38:39.955209 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.network.neutron [None req-6b1e8ff6-df69-475c-853d-888d0e583fe2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] validate_networks() for [('6f4781da-a0dc-4d72-b7f3-ed072b6cdb61', None, None, None, None, None)] {{(pid=121428) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:38:40.299344 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-6b1e8ff6-df69-475c-853d-888d0e583fe2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Flavor limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:38:40.299762 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-6b1e8ff6-df69-475c-853d-888d0e583fe2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Image limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:38:40.300358 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-6b1e8ff6-df69-475c-853d-888d0e583fe2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Flavor pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:38:40.300800 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-6b1e8ff6-df69-475c-853d-888d0e583fe2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Image pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:38:40.301209 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-6b1e8ff6-df69-475c-853d-888d0e583fe2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:38:40.309878 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6b1e8ff6-df69-475c-853d-888d0e583fe2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:40.310388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6b1e8ff6-df69-475c-853d-888d0e583fe2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:40.310818 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6b1e8ff6-df69-475c-853d-888d0e583fe2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:40.311537 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6b1e8ff6-df69-475c-853d-888d0e583fe2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:40.312002 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6b1e8ff6-df69-475c-853d-888d0e583fe2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:40.312407 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6b1e8ff6-df69-475c-853d-888d0e583fe2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:40.329100 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-6b1e8ff6-df69-475c-853d-888d0e583fe2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Getting quotas for project 1bbe76fb2fe04cd391a40a4d9abe53f2. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:38:40.333151 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-6b1e8ff6-df69-475c-853d-888d0e583fe2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Getting quotas for user 8fe84e2ed72343c8b8e787075efb1edd and project 1bbe76fb2fe04cd391a40a4d9abe53f2. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:38:40.344433 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6b1e8ff6-df69-475c-853d-888d0e583fe2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Going to run 1 instances... {{(pid=121428) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:38:40.346804 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6b1e8ff6-df69-475c-853d-888d0e583fe2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: ad534a09-9f69-4270-886a-21ca71e3b356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4301833-8e96-46bf-a940-692f93f7fdba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:38:40.504381 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-6b1e8ff6-df69-475c-853d-888d0e583fe2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615723 Sep 19 12:38:40.505056 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 470/947] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:38:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:38:40.514972 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:38:40.515509 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Mon Sep 19 12:38:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356 (ip 10.222.0.93) !!! Sep 19 12:38:40.516399 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:38:40.517169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:38:40.521963 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-14a077cd-ba5d-4cc3-848d-e743d4eaf31f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:40.522782 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-14a077cd-ba5d-4cc3-848d-e743d4eaf31f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: ad534a09-9f69-4270-886a-21ca71e3b356] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:40.579724 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-14a077cd-ba5d-4cc3-848d-e743d4eaf31f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:40.588221 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-14a077cd-ba5d-4cc3-848d-e743d4eaf31f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356" status: 200 len: 1214 microversion: 2.1 time: 0.075016 Sep 19 12:38:40.588824 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 478/948] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:40 2022] GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:41.611988 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a317732c-55d9-451b-910a-261057e37ae5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:41.612638 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a317732c-55d9-451b-910a-261057e37ae5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: ad534a09-9f69-4270-886a-21ca71e3b356] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:41.619429 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a317732c-55d9-451b-910a-261057e37ae5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:41.619901 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a317732c-55d9-451b-910a-261057e37ae5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:41.620425 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a317732c-55d9-451b-910a-261057e37ae5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:41.621139 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a317732c-55d9-451b-910a-261057e37ae5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:41.621585 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a317732c-55d9-451b-910a-261057e37ae5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:41.622003 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a317732c-55d9-451b-910a-261057e37ae5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:41.683038 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-a317732c-55d9-451b-910a-261057e37ae5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:41.690880 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a317732c-55d9-451b-910a-261057e37ae5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356" status: 200 len: 1218 microversion: 2.1 time: 0.083431 Sep 19 12:38:41.691461 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 471/949] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:41 2022] GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:42.713999 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-af7d387d-99e1-474a-a923-610001b91707 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:42.714549 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-af7d387d-99e1-474a-a923-610001b91707 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: ad534a09-9f69-4270-886a-21ca71e3b356] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:42.721898 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-af7d387d-99e1-474a-a923-610001b91707 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:42.722377 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-af7d387d-99e1-474a-a923-610001b91707 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:42.722817 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-af7d387d-99e1-474a-a923-610001b91707 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:42.723513 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-af7d387d-99e1-474a-a923-610001b91707 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:42.723965 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-af7d387d-99e1-474a-a923-610001b91707 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:42.724425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-af7d387d-99e1-474a-a923-610001b91707 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:42.786971 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-af7d387d-99e1-474a-a923-610001b91707 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:42.795998 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-af7d387d-99e1-474a-a923-610001b91707 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356" status: 200 len: 1266 microversion: 2.1 time: 0.086610 Sep 19 12:38:42.796637 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 479/950] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:42 2022] GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:43.819415 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-6c9d6fe3-c696-4f8e-9b5d-9a3b1eef38a4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:43.819998 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6c9d6fe3-c696-4f8e-9b5d-9a3b1eef38a4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: ad534a09-9f69-4270-886a-21ca71e3b356] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:43.826967 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6c9d6fe3-c696-4f8e-9b5d-9a3b1eef38a4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:43.827450 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6c9d6fe3-c696-4f8e-9b5d-9a3b1eef38a4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:43.827886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6c9d6fe3-c696-4f8e-9b5d-9a3b1eef38a4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:43.828616 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6c9d6fe3-c696-4f8e-9b5d-9a3b1eef38a4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:43.829065 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6c9d6fe3-c696-4f8e-9b5d-9a3b1eef38a4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:43.829495 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6c9d6fe3-c696-4f8e-9b5d-9a3b1eef38a4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:44.026510 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-6c9d6fe3-c696-4f8e-9b5d-9a3b1eef38a4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:44.034720 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-6c9d6fe3-c696-4f8e-9b5d-9a3b1eef38a4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356" status: 200 len: 1314 microversion: 2.1 time: 0.219267 Sep 19 12:38:44.039706 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 472/951] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:43 2022] GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:44.720212 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-2a776dbf-8ddc-4e3a-914d-149a912a6d09 req-2d58a68b-8fa5-4828-9dd6-0c588456795c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad534a09-9f69-4270-886a-21ca71e3b356", "tag": "727e4e7d-f9ff-484a-8d7f-f38b853e4194"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:38:44.731318 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-2a776dbf-8ddc-4e3a-914d-149a912a6d09 req-2d58a68b-8fa5-4828-9dd6-0c588456795c service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:44.731788 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-2a776dbf-8ddc-4e3a-914d-149a912a6d09 req-2d58a68b-8fa5-4828-9dd6-0c588456795c service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:44.732213 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-2a776dbf-8ddc-4e3a-914d-149a912a6d09 req-2d58a68b-8fa5-4828-9dd6-0c588456795c service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:44.743304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-2a776dbf-8ddc-4e3a-914d-149a912a6d09 req-2d58a68b-8fa5-4828-9dd6-0c588456795c service nova] Creating event network-changed:727e4e7d-f9ff-484a-8d7f-f38b853e4194 for instance ad534a09-9f69-4270-886a-21ca71e3b356 on hv-cinder-85061 Sep 19 12:38:44.748477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-2a776dbf-8ddc-4e3a-914d-149a912a6d09 req-2d58a68b-8fa5-4828-9dd6-0c588456795c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031995 Sep 19 12:38:44.750610 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 480/952] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:38:45.058746 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-0fb26b6c-5c4b-418d-ae8c-52bd8ff68bbc tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:45.059507 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-0fb26b6c-5c4b-418d-ae8c-52bd8ff68bbc tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: ad534a09-9f69-4270-886a-21ca71e3b356] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:45.066965 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0fb26b6c-5c4b-418d-ae8c-52bd8ff68bbc tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:45.067450 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0fb26b6c-5c4b-418d-ae8c-52bd8ff68bbc tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:45.067885 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0fb26b6c-5c4b-418d-ae8c-52bd8ff68bbc tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:45.068622 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0fb26b6c-5c4b-418d-ae8c-52bd8ff68bbc tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:45.069079 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0fb26b6c-5c4b-418d-ae8c-52bd8ff68bbc tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:45.069502 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0fb26b6c-5c4b-418d-ae8c-52bd8ff68bbc tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:45.298798 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-0fb26b6c-5c4b-418d-ae8c-52bd8ff68bbc tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:45.307158 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-0fb26b6c-5c4b-418d-ae8c-52bd8ff68bbc tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356" status: 200 len: 1314 microversion: 2.1 time: 0.252275 Sep 19 12:38:45.307841 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 473/953] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:45 2022] GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:46.331642 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-779a3f68-69ee-4e41-81dd-63e07c0d3304 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:46.332334 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-779a3f68-69ee-4e41-81dd-63e07c0d3304 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: ad534a09-9f69-4270-886a-21ca71e3b356] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:46.343812 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-779a3f68-69ee-4e41-81dd-63e07c0d3304 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:46.344310 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-779a3f68-69ee-4e41-81dd-63e07c0d3304 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:46.344740 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-779a3f68-69ee-4e41-81dd-63e07c0d3304 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:46.345457 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-779a3f68-69ee-4e41-81dd-63e07c0d3304 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:46.345931 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-779a3f68-69ee-4e41-81dd-63e07c0d3304 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:46.346349 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-779a3f68-69ee-4e41-81dd-63e07c0d3304 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:46.476525 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-779a3f68-69ee-4e41-81dd-63e07c0d3304 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:46.484032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-779a3f68-69ee-4e41-81dd-63e07c0d3304 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356" status: 200 len: 1314 microversion: 2.1 time: 0.156654 Sep 19 12:38:46.484615 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 481/954] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:46 2022] GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:47.507108 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-35f40c29-5792-409f-9c24-ed96d8d58c00 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:47.507791 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-35f40c29-5792-409f-9c24-ed96d8d58c00 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: ad534a09-9f69-4270-886a-21ca71e3b356] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:47.514240 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-35f40c29-5792-409f-9c24-ed96d8d58c00 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:47.516293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-35f40c29-5792-409f-9c24-ed96d8d58c00 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:47.516293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-35f40c29-5792-409f-9c24-ed96d8d58c00 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:47.516293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-35f40c29-5792-409f-9c24-ed96d8d58c00 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:47.516293 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-35f40c29-5792-409f-9c24-ed96d8d58c00 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:47.516738 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-35f40c29-5792-409f-9c24-ed96d8d58c00 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:47.646985 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-35f40c29-5792-409f-9c24-ed96d8d58c00 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:47.654820 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-35f40c29-5792-409f-9c24-ed96d8d58c00 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356" status: 200 len: 1314 microversion: 2.1 time: 0.151566 Sep 19 12:38:47.655388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 474/955] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:47 2022] GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:48.678569 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5d81f905-9bc0-49be-990e-f11e19a29ee9 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:48.679201 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-5d81f905-9bc0-49be-990e-f11e19a29ee9 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: ad534a09-9f69-4270-886a-21ca71e3b356] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:48.685572 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5d81f905-9bc0-49be-990e-f11e19a29ee9 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:48.686046 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5d81f905-9bc0-49be-990e-f11e19a29ee9 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:48.686475 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5d81f905-9bc0-49be-990e-f11e19a29ee9 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:48.687247 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5d81f905-9bc0-49be-990e-f11e19a29ee9 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:48.687692 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5d81f905-9bc0-49be-990e-f11e19a29ee9 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:48.688108 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5d81f905-9bc0-49be-990e-f11e19a29ee9 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:48.817455 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-5d81f905-9bc0-49be-990e-f11e19a29ee9 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:48.825654 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5d81f905-9bc0-49be-990e-f11e19a29ee9 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356" status: 200 len: 1314 microversion: 2.1 time: 0.151108 Sep 19 12:38:48.826209 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 482/956] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:48 2022] GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:49.414127 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-0c8ff3f6-f239-4d2e-85bf-18efe2bb6f35 req-c3f59aa6-ed4a-450f-a739-3e84ed665e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad534a09-9f69-4270-886a-21ca71e3b356", "name": "network-vif-plugged", "status": "completed", "tag": "727e4e7d-f9ff-484a-8d7f-f38b853e4194"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:38:49.416741 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-0c8ff3f6-f239-4d2e-85bf-18efe2bb6f35 req-c3f59aa6-ed4a-450f-a739-3e84ed665e1c service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:49.417234 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-0c8ff3f6-f239-4d2e-85bf-18efe2bb6f35 req-c3f59aa6-ed4a-450f-a739-3e84ed665e1c service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:49.417671 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-0c8ff3f6-f239-4d2e-85bf-18efe2bb6f35 req-c3f59aa6-ed4a-450f-a739-3e84ed665e1c service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:49.428508 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-0c8ff3f6-f239-4d2e-85bf-18efe2bb6f35 req-c3f59aa6-ed4a-450f-a739-3e84ed665e1c service nova] Creating event network-vif-plugged:727e4e7d-f9ff-484a-8d7f-f38b853e4194 for instance ad534a09-9f69-4270-886a-21ca71e3b356 on hv-cinder-85061 Sep 19 12:38:49.433693 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-0c8ff3f6-f239-4d2e-85bf-18efe2bb6f35 req-c3f59aa6-ed4a-450f-a739-3e84ed665e1c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031115 Sep 19 12:38:49.434345 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 475/957] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:38:49.848966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c9523ad6-46b5-4725-aad2-4f1bf4b3445f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:49.849605 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c9523ad6-46b5-4725-aad2-4f1bf4b3445f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: ad534a09-9f69-4270-886a-21ca71e3b356] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:49.855978 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c9523ad6-46b5-4725-aad2-4f1bf4b3445f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:49.856449 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c9523ad6-46b5-4725-aad2-4f1bf4b3445f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:49.856917 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c9523ad6-46b5-4725-aad2-4f1bf4b3445f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:49.857604 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c9523ad6-46b5-4725-aad2-4f1bf4b3445f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:49.858052 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c9523ad6-46b5-4725-aad2-4f1bf4b3445f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:49.858471 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c9523ad6-46b5-4725-aad2-4f1bf4b3445f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:49.986319 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c9523ad6-46b5-4725-aad2-4f1bf4b3445f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:49.994031 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c9523ad6-46b5-4725-aad2-4f1bf4b3445f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356" status: 200 len: 1314 microversion: 2.1 time: 0.149205 Sep 19 12:38:49.995094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 483/958] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:49 2022] GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:51.014398 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=2 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:38:51.015080 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=6 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:38:51.019558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c5a86498-b0ae-49e2-849f-9af661e5ae8d tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:51.020255 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c5a86498-b0ae-49e2-849f-9af661e5ae8d tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: ad534a09-9f69-4270-886a-21ca71e3b356] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:51.026736 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c5a86498-b0ae-49e2-849f-9af661e5ae8d tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:51.031506 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c5a86498-b0ae-49e2-849f-9af661e5ae8d tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:51.031506 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c5a86498-b0ae-49e2-849f-9af661e5ae8d tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:51.031506 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c5a86498-b0ae-49e2-849f-9af661e5ae8d tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:51.031506 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c5a86498-b0ae-49e2-849f-9af661e5ae8d tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:51.031889 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c5a86498-b0ae-49e2-849f-9af661e5ae8d tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:51.161628 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c5a86498-b0ae-49e2-849f-9af661e5ae8d tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:51.169264 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c5a86498-b0ae-49e2-849f-9af661e5ae8d tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356" status: 200 len: 1314 microversion: 2.1 time: 0.155890 Sep 19 12:38:51.169868 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 476/959] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:51 2022] GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:52.191543 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-0db5e884-52a4-44b6-b38d-4774c3ad71a1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:52.192133 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-0db5e884-52a4-44b6-b38d-4774c3ad71a1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: ad534a09-9f69-4270-886a-21ca71e3b356] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:52.194150 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=2 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:38:52.200070 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0db5e884-52a4-44b6-b38d-4774c3ad71a1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:52.203572 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0db5e884-52a4-44b6-b38d-4774c3ad71a1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:52.203572 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0db5e884-52a4-44b6-b38d-4774c3ad71a1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:52.203572 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0db5e884-52a4-44b6-b38d-4774c3ad71a1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:52.203572 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0db5e884-52a4-44b6-b38d-4774c3ad71a1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:52.203945 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0db5e884-52a4-44b6-b38d-4774c3ad71a1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:52.330192 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-0db5e884-52a4-44b6-b38d-4774c3ad71a1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:52.337883 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-0db5e884-52a4-44b6-b38d-4774c3ad71a1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356" status: 200 len: 1498 microversion: 2.1 time: 0.150321 Sep 19 12:38:52.338495 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 484/960] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:52 2022] GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356 => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:53.257223 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f91abb4d-b3f0-4f8b-88c3-67aa8c6e23c5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:53.257767 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f91abb4d-b3f0-4f8b-88c3-67aa8c6e23c5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: ad534a09-9f69-4270-886a-21ca71e3b356] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:53.264322 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f91abb4d-b3f0-4f8b-88c3-67aa8c6e23c5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:53.264858 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f91abb4d-b3f0-4f8b-88c3-67aa8c6e23c5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:53.265296 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f91abb4d-b3f0-4f8b-88c3-67aa8c6e23c5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:53.266017 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f91abb4d-b3f0-4f8b-88c3-67aa8c6e23c5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:53.266489 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f91abb4d-b3f0-4f8b-88c3-67aa8c6e23c5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:53.266910 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f91abb4d-b3f0-4f8b-88c3-67aa8c6e23c5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:53.295014 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f91abb4d-b3f0-4f8b-88c3-67aa8c6e23c5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: ad534a09-9f69-4270-886a-21ca71e3b356] Going to try to terminate instance {{(pid=121428) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:38:53.628387 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f91abb4d-b3f0-4f8b-88c3-67aa8c6e23c5 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356" status: 204 len: 0 microversion: 2.1 time: 0.374807 Sep 19 12:38:53.629080 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 477/961] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:38:53 2022] DELETE /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:38:53.638094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-bbcb5cd4-7921-4b11-ac76-c64f7f289557 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:53.643543 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-bbcb5cd4-7921-4b11-ac76-c64f7f289557 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: ad534a09-9f69-4270-886a-21ca71e3b356] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:53.645291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bbcb5cd4-7921-4b11-ac76-c64f7f289557 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:53.645777 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bbcb5cd4-7921-4b11-ac76-c64f7f289557 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:53.646218 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bbcb5cd4-7921-4b11-ac76-c64f7f289557 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:53.646920 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bbcb5cd4-7921-4b11-ac76-c64f7f289557 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:53.647377 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bbcb5cd4-7921-4b11-ac76-c64f7f289557 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:53.647808 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bbcb5cd4-7921-4b11-ac76-c64f7f289557 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:53.782828 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-bbcb5cd4-7921-4b11-ac76-c64f7f289557 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:53.790530 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-bbcb5cd4-7921-4b11-ac76-c64f7f289557 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356" status: 200 len: 1504 microversion: 2.1 time: 0.156947 Sep 19 12:38:53.791091 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 485/962] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:53 2022] GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:54.815267 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-0c590165-8842-413b-9980-c52af24ffb1f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:54.815962 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-0c590165-8842-413b-9980-c52af24ffb1f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: ad534a09-9f69-4270-886a-21ca71e3b356] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:54.822395 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0c590165-8842-413b-9980-c52af24ffb1f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:54.822858 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0c590165-8842-413b-9980-c52af24ffb1f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:54.823286 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0c590165-8842-413b-9980-c52af24ffb1f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:54.823972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0c590165-8842-413b-9980-c52af24ffb1f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:54.824421 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0c590165-8842-413b-9980-c52af24ffb1f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:54.824936 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0c590165-8842-413b-9980-c52af24ffb1f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:54.953359 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-0c590165-8842-413b-9980-c52af24ffb1f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:54.960958 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-0c590165-8842-413b-9980-c52af24ffb1f tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356" status: 200 len: 1504 microversion: 2.1 time: 0.149979 Sep 19 12:38:54.961523 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 478/963] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:54 2022] GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:55.972457 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-d0273357-aef8-4406-9e26-2d84e90feeda req-2eaf8480-c0d7-4890-b698-46a00c9b89bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad534a09-9f69-4270-886a-21ca71e3b356", "name": "network-vif-deleted", "tag": "727e4e7d-f9ff-484a-8d7f-f38b853e4194"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:38:55.983359 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-d0273357-aef8-4406-9e26-2d84e90feeda req-2eaf8480-c0d7-4890-b698-46a00c9b89bc service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:55.984097 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-d0273357-aef8-4406-9e26-2d84e90feeda req-2eaf8480-c0d7-4890-b698-46a00c9b89bc service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:55.984520 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-d0273357-aef8-4406-9e26-2d84e90feeda req-2eaf8480-c0d7-4890-b698-46a00c9b89bc service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:55.984820 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-03d2f2ca-f6bc-426b-b7d8-4f41fa33567c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:55.985484 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-03d2f2ca-f6bc-426b-b7d8-4f41fa33567c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: ad534a09-9f69-4270-886a-21ca71e3b356] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:55.991719 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-03d2f2ca-f6bc-426b-b7d8-4f41fa33567c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:55.992201 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-03d2f2ca-f6bc-426b-b7d8-4f41fa33567c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:55.992720 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-03d2f2ca-f6bc-426b-b7d8-4f41fa33567c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:55.993415 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-03d2f2ca-f6bc-426b-b7d8-4f41fa33567c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:55.993866 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-03d2f2ca-f6bc-426b-b7d8-4f41fa33567c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:55.994287 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-03d2f2ca-f6bc-426b-b7d8-4f41fa33567c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:55.995906 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-d0273357-aef8-4406-9e26-2d84e90feeda req-2eaf8480-c0d7-4890-b698-46a00c9b89bc service nova] Creating event network-vif-deleted:727e4e7d-f9ff-484a-8d7f-f38b853e4194 for instance ad534a09-9f69-4270-886a-21ca71e3b356 on hv-cinder-85061 Sep 19 12:38:56.002139 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-d0273357-aef8-4406-9e26-2d84e90feeda req-2eaf8480-c0d7-4890-b698-46a00c9b89bc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033074 Sep 19 12:38:56.002986 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 486/964] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:38:56.060423 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-03d2f2ca-f6bc-426b-b7d8-4f41fa33567c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:56.068493 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-03d2f2ca-f6bc-426b-b7d8-4f41fa33567c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356" status: 200 len: 1462 microversion: 2.1 time: 0.088054 Sep 19 12:38:56.069104 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 479/965] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:55 2022] GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356 => generated 1462 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:38:57.092493 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c872dfc6-cd1d-4e1d-9b86-06aec03619b7 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:57.093229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c872dfc6-cd1d-4e1d-9b86-06aec03619b7 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: ad534a09-9f69-4270-886a-21ca71e3b356] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:57.100093 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c872dfc6-cd1d-4e1d-9b86-06aec03619b7 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:57.100575 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c872dfc6-cd1d-4e1d-9b86-06aec03619b7 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:57.101044 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c872dfc6-cd1d-4e1d-9b86-06aec03619b7 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:57.101739 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c872dfc6-cd1d-4e1d-9b86-06aec03619b7 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:57.102194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c872dfc6-cd1d-4e1d-9b86-06aec03619b7 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:57.102621 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c872dfc6-cd1d-4e1d-9b86-06aec03619b7 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:57.115752 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-c872dfc6-cd1d-4e1d-9b86-06aec03619b7 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] HTTP exception thrown: Instance ad534a09-9f69-4270-886a-21ca71e3b356 could not be found. Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c872dfc6-cd1d-4e1d-9b86-06aec03619b7 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Request method failure captured: Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356 HTTP/1.1 Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKGLN1f9FchhPpZVXvq2x76VqNPKhQygmSyYnFZ2rrfYbgqvtlTXqHHs7XfzPmUtdMU6TFvlCgytd0f4Nh-h1pLQRk-PkDcxd42-pUZ10MGGx7ap7Rgs4ofEVpGf5mJSOlnBOeTXlqmJW5EBsgsYYKIBcL9gdABUzdatyHC6zj6co7F0 Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 1bbe76fb2fe04cd391a40a4d9abe53f2 Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-VolumesActionsTest-919474340 Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:38:57.117425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:38:57.119141 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1bbe76fb2fe04cd391a40a4d9abe53f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1bbe76fb2fe04cd391a40a4d9abe53f2", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1bbe76fb2fe04cd391a40a4d9abe53f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1bbe76fb2fe04cd391a40a4d9abe53f2"}]}] Sep 19 12:38:57.119141 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-VolumesActionsTest-919474340 Sep 19 12:38:57.119141 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 1bbe76fb2fe04cd391a40a4d9abe53f2 Sep 19 12:38:57.119141 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-VolumesActionsTest-919474340 Sep 19 12:38:57.119141 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-VolumesActionsTest-919474340-project Sep 19 12:38:57.119141 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:38:57.119141 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:38:57.119141 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 8fe84e2ed72343c8b8e787075efb1edd Sep 19 12:38:57.119141 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-VolumesActionsTest-919474340-project Sep 19 12:38:57.119141 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:38:57.119141 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance ad534a09-9f69-4270-886a-21ca71e3b356 could not be found. Sep 19 12:38:57.119141 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': 'ad534a09-9f69-4270-886a-21ca71e3b356'} Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad534a09-9f69-4270-886a-21ca71e3b356 could not be found. Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:38:57.120272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:38:57.122763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:38:57.122763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:38:57.122763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:38:57.122763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:38:57.122763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:38:57.122763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:38:57.122763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:38:57.122763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad534a09-9f69-4270-886a-21ca71e3b356 could not be found. Sep 19 12:38:57.122763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:38:57.122763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:38:57.122763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:38:57.122763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:38:57.122763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:38:57.122763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:38:57.122763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:38:57.122763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:38:57.122763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad534a09-9f69-4270-886a-21ca71e3b356 could not be found. Sep 19 12:38:57.122763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:38:57.125052 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c872dfc6-cd1d-4e1d-9b86-06aec03619b7 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Returning 404 to user: Instance ad534a09-9f69-4270-886a-21ca71e3b356 could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:38:57.125052 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c872dfc6-cd1d-4e1d-9b86-06aec03619b7 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356" status: 404 len: 111 microversion: 2.1 time: 0.031209 Sep 19 12:38:57.125052 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 487/966] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:57 2022] GET /compute/v2.1/servers/ad534a09-9f69-4270-886a-21ca71e3b356 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:38:57.171549 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f9999ea8-ab27-4e65-9ac7-a61b533d9bf2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1837267001", "imageRef": "d4301833-8e96-46bf-a940-692f93f7fdba", "flavorRef": "452", "networks": [{"uuid": "6f4781da-a0dc-4d72-b7f3-ed072b6cdb61"}]}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:38:57.225818 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.network.neutron [None req-f9999ea8-ab27-4e65-9ac7-a61b533d9bf2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] validate_networks() for [('6f4781da-a0dc-4d72-b7f3-ed072b6cdb61', None, None, None, None, None)] {{(pid=121428) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:38:57.833635 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-f9999ea8-ab27-4e65-9ac7-a61b533d9bf2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Flavor limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:38:57.834059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-f9999ea8-ab27-4e65-9ac7-a61b533d9bf2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Image limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:38:57.834546 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-f9999ea8-ab27-4e65-9ac7-a61b533d9bf2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Flavor pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:38:57.834975 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-f9999ea8-ab27-4e65-9ac7-a61b533d9bf2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Image pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:38:57.835378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-f9999ea8-ab27-4e65-9ac7-a61b533d9bf2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:38:57.844682 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f9999ea8-ab27-4e65-9ac7-a61b533d9bf2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:57.845155 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f9999ea8-ab27-4e65-9ac7-a61b533d9bf2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:57.845581 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f9999ea8-ab27-4e65-9ac7-a61b533d9bf2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:57.848674 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f9999ea8-ab27-4e65-9ac7-a61b533d9bf2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:57.848674 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f9999ea8-ab27-4e65-9ac7-a61b533d9bf2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:57.848674 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f9999ea8-ab27-4e65-9ac7-a61b533d9bf2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:57.863992 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-f9999ea8-ab27-4e65-9ac7-a61b533d9bf2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Getting quotas for project 1bbe76fb2fe04cd391a40a4d9abe53f2. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:38:57.868094 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-f9999ea8-ab27-4e65-9ac7-a61b533d9bf2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Getting quotas for user 8fe84e2ed72343c8b8e787075efb1edd and project 1bbe76fb2fe04cd391a40a4d9abe53f2. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:38:57.879023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f9999ea8-ab27-4e65-9ac7-a61b533d9bf2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Going to run 1 instances... {{(pid=121428) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:38:57.881326 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f9999ea8-ab27-4e65-9ac7-a61b533d9bf2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: bd7bbf9d-0062-431f-bc51-73c899732186] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4301833-8e96-46bf-a940-692f93f7fdba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:38:58.001301 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f9999ea8-ab27-4e65-9ac7-a61b533d9bf2 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.833520 Sep 19 12:38:58.002153 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 480/967] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:38:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:38:58.013893 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-61d7d15c-0e58-4897-a853-420c99962327 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:58.014546 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-61d7d15c-0e58-4897-a853-420c99962327 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: bd7bbf9d-0062-431f-bc51-73c899732186] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:58.069132 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-61d7d15c-0e58-4897-a853-420c99962327 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:58.076124 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-61d7d15c-0e58-4897-a853-420c99962327 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186" status: 200 len: 1214 microversion: 2.1 time: 0.066360 Sep 19 12:38:58.076756 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 488/968] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:58 2022] GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:38:59.099885 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d3327c4b-d312-4217-9c80-6b746e4d3ec3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:38:59.100433 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d3327c4b-d312-4217-9c80-6b746e4d3ec3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: bd7bbf9d-0062-431f-bc51-73c899732186] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:38:59.107995 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3327c4b-d312-4217-9c80-6b746e4d3ec3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:59.108476 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3327c4b-d312-4217-9c80-6b746e4d3ec3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:59.108930 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3327c4b-d312-4217-9c80-6b746e4d3ec3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:59.109610 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3327c4b-d312-4217-9c80-6b746e4d3ec3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:38:59.110054 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3327c4b-d312-4217-9c80-6b746e4d3ec3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:38:59.110468 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d3327c4b-d312-4217-9c80-6b746e4d3ec3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:38:59.173752 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-d3327c4b-d312-4217-9c80-6b746e4d3ec3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:38:59.181897 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d3327c4b-d312-4217-9c80-6b746e4d3ec3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186" status: 200 len: 1210 microversion: 2.1 time: 0.086464 Sep 19 12:38:59.187673 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 481/969] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:38:59 2022] GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:00.206043 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-97c98527-2e7c-44a6-97c9-93d3b9321963 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:00.206655 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-97c98527-2e7c-44a6-97c9-93d3b9321963 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: bd7bbf9d-0062-431f-bc51-73c899732186] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:00.214726 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-97c98527-2e7c-44a6-97c9-93d3b9321963 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:00.215329 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-97c98527-2e7c-44a6-97c9-93d3b9321963 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:00.215702 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-97c98527-2e7c-44a6-97c9-93d3b9321963 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:00.216399 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-97c98527-2e7c-44a6-97c9-93d3b9321963 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:00.216873 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-97c98527-2e7c-44a6-97c9-93d3b9321963 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:00.217302 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-97c98527-2e7c-44a6-97c9-93d3b9321963 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:00.307172 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-97c98527-2e7c-44a6-97c9-93d3b9321963 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:00.315325 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-97c98527-2e7c-44a6-97c9-93d3b9321963 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186" status: 200 len: 1272 microversion: 2.1 time: 0.113168 Sep 19 12:39:00.315888 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 489/970] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:00 2022] GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186 => generated 1272 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:01.339060 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-47b91857-ba02-483e-ac05-955d38c85a3b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:01.339645 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-47b91857-ba02-483e-ac05-955d38c85a3b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: bd7bbf9d-0062-431f-bc51-73c899732186] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:01.346317 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-47b91857-ba02-483e-ac05-955d38c85a3b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:01.346669 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-47b91857-ba02-483e-ac05-955d38c85a3b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:01.347096 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-47b91857-ba02-483e-ac05-955d38c85a3b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:01.347782 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-47b91857-ba02-483e-ac05-955d38c85a3b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:01.348227 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-47b91857-ba02-483e-ac05-955d38c85a3b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:01.348664 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-47b91857-ba02-483e-ac05-955d38c85a3b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:01.516655 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-47b91857-ba02-483e-ac05-955d38c85a3b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:01.524386 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-47b91857-ba02-483e-ac05-955d38c85a3b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186" status: 200 len: 1314 microversion: 2.1 time: 0.189156 Sep 19 12:39:01.524997 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 482/971] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:01 2022] GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:01.553344 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-1be8cdb8-4def-4834-93e0-898cfdc30bcd req-fe2a0ada-c7bd-4929-bbf9-63b857a565c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd7bbf9d-0062-431f-bc51-73c899732186", "tag": "e57d730c-79e9-4379-8654-5f4f05701abb"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:39:01.563689 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-1be8cdb8-4def-4834-93e0-898cfdc30bcd req-fe2a0ada-c7bd-4929-bbf9-63b857a565c3 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:01.564190 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-1be8cdb8-4def-4834-93e0-898cfdc30bcd req-fe2a0ada-c7bd-4929-bbf9-63b857a565c3 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:01.564627 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-1be8cdb8-4def-4834-93e0-898cfdc30bcd req-fe2a0ada-c7bd-4929-bbf9-63b857a565c3 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:01.578207 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-1be8cdb8-4def-4834-93e0-898cfdc30bcd req-fe2a0ada-c7bd-4929-bbf9-63b857a565c3 service nova] Creating event network-changed:e57d730c-79e9-4379-8654-5f4f05701abb for instance bd7bbf9d-0062-431f-bc51-73c899732186 on hv-cinder-85061 Sep 19 12:39:01.583187 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-1be8cdb8-4def-4834-93e0-898cfdc30bcd req-fe2a0ada-c7bd-4929-bbf9-63b857a565c3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034121 Sep 19 12:39:01.584074 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 490/972] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:39:02.548127 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-65cfb5dd-6285-4c1e-8581-2cd3f675382b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:02.548742 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-65cfb5dd-6285-4c1e-8581-2cd3f675382b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: bd7bbf9d-0062-431f-bc51-73c899732186] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:02.555164 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65cfb5dd-6285-4c1e-8581-2cd3f675382b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:02.555664 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65cfb5dd-6285-4c1e-8581-2cd3f675382b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:02.556096 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65cfb5dd-6285-4c1e-8581-2cd3f675382b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:02.556876 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65cfb5dd-6285-4c1e-8581-2cd3f675382b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:02.557327 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65cfb5dd-6285-4c1e-8581-2cd3f675382b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:02.557748 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-65cfb5dd-6285-4c1e-8581-2cd3f675382b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:02.687869 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-65cfb5dd-6285-4c1e-8581-2cd3f675382b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:02.695525 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-65cfb5dd-6285-4c1e-8581-2cd3f675382b tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186" status: 200 len: 1314 microversion: 2.1 time: 0.152052 Sep 19 12:39:02.696092 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 483/973] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:02 2022] GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:03.720244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-0200791a-ae36-49de-bcc0-43419b98e97c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:03.721004 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-0200791a-ae36-49de-bcc0-43419b98e97c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: bd7bbf9d-0062-431f-bc51-73c899732186] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:03.727484 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0200791a-ae36-49de-bcc0-43419b98e97c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:03.728078 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0200791a-ae36-49de-bcc0-43419b98e97c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:03.728509 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0200791a-ae36-49de-bcc0-43419b98e97c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:03.729225 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0200791a-ae36-49de-bcc0-43419b98e97c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:03.729676 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0200791a-ae36-49de-bcc0-43419b98e97c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:03.730094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-0200791a-ae36-49de-bcc0-43419b98e97c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:03.862960 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-0200791a-ae36-49de-bcc0-43419b98e97c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:03.871006 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-0200791a-ae36-49de-bcc0-43419b98e97c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186" status: 200 len: 1314 microversion: 2.1 time: 0.156707 Sep 19 12:39:03.871590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 491/974] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:03 2022] GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:04.894663 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-1ca1a01d-07f0-490f-b49a-6ee12e9debc1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:04.895300 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-1ca1a01d-07f0-490f-b49a-6ee12e9debc1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: bd7bbf9d-0062-431f-bc51-73c899732186] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:04.902383 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1ca1a01d-07f0-490f-b49a-6ee12e9debc1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:04.902860 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1ca1a01d-07f0-490f-b49a-6ee12e9debc1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:04.903286 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1ca1a01d-07f0-490f-b49a-6ee12e9debc1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:04.903977 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1ca1a01d-07f0-490f-b49a-6ee12e9debc1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:04.904944 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1ca1a01d-07f0-490f-b49a-6ee12e9debc1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:04.905360 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1ca1a01d-07f0-490f-b49a-6ee12e9debc1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:05.037818 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-1ca1a01d-07f0-490f-b49a-6ee12e9debc1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:05.045571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-1ca1a01d-07f0-490f-b49a-6ee12e9debc1 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186" status: 200 len: 1314 microversion: 2.1 time: 0.155107 Sep 19 12:39:05.046148 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 484/975] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:04 2022] GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:06.068995 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3ce22557-d58c-45aa-9f55-ebd5515200d3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:06.069612 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3ce22557-d58c-45aa-9f55-ebd5515200d3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: bd7bbf9d-0062-431f-bc51-73c899732186] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:06.076283 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3ce22557-d58c-45aa-9f55-ebd5515200d3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:06.077343 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3ce22557-d58c-45aa-9f55-ebd5515200d3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:06.077785 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3ce22557-d58c-45aa-9f55-ebd5515200d3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:06.078480 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3ce22557-d58c-45aa-9f55-ebd5515200d3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:06.078935 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3ce22557-d58c-45aa-9f55-ebd5515200d3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:06.079362 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3ce22557-d58c-45aa-9f55-ebd5515200d3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:06.211308 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3ce22557-d58c-45aa-9f55-ebd5515200d3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:06.219265 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3ce22557-d58c-45aa-9f55-ebd5515200d3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186" status: 200 len: 1314 microversion: 2.1 time: 0.154283 Sep 19 12:39:06.219826 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 492/976] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:06 2022] GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:07.242260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-bb7f35ca-4280-4a5a-b77b-8168bbbf5b35 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:07.242799 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-bb7f35ca-4280-4a5a-b77b-8168bbbf5b35 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: bd7bbf9d-0062-431f-bc51-73c899732186] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:07.248762 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bb7f35ca-4280-4a5a-b77b-8168bbbf5b35 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:07.249309 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bb7f35ca-4280-4a5a-b77b-8168bbbf5b35 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:07.250248 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bb7f35ca-4280-4a5a-b77b-8168bbbf5b35 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:07.250963 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bb7f35ca-4280-4a5a-b77b-8168bbbf5b35 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:07.251670 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bb7f35ca-4280-4a5a-b77b-8168bbbf5b35 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:07.252093 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-bb7f35ca-4280-4a5a-b77b-8168bbbf5b35 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:07.384718 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-bb7f35ca-4280-4a5a-b77b-8168bbbf5b35 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:07.392856 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-bb7f35ca-4280-4a5a-b77b-8168bbbf5b35 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186" status: 200 len: 1314 microversion: 2.1 time: 0.154924 Sep 19 12:39:07.393422 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 485/977] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:07 2022] GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:07.504810 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-abb99d7a-b6c1-41b8-a7aa-aef053873443 req-e7d3e83c-99a6-49c3-83ef-174fd7fd567e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd7bbf9d-0062-431f-bc51-73c899732186", "name": "network-vif-plugged", "status": "completed", "tag": "e57d730c-79e9-4379-8654-5f4f05701abb"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:39:07.515493 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-abb99d7a-b6c1-41b8-a7aa-aef053873443 req-e7d3e83c-99a6-49c3-83ef-174fd7fd567e service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:07.516098 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-abb99d7a-b6c1-41b8-a7aa-aef053873443 req-e7d3e83c-99a6-49c3-83ef-174fd7fd567e service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:07.517551 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-abb99d7a-b6c1-41b8-a7aa-aef053873443 req-e7d3e83c-99a6-49c3-83ef-174fd7fd567e service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:07.527597 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-abb99d7a-b6c1-41b8-a7aa-aef053873443 req-e7d3e83c-99a6-49c3-83ef-174fd7fd567e service nova] Creating event network-vif-plugged:e57d730c-79e9-4379-8654-5f4f05701abb for instance bd7bbf9d-0062-431f-bc51-73c899732186 on hv-cinder-85061 Sep 19 12:39:07.532710 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-abb99d7a-b6c1-41b8-a7aa-aef053873443 req-e7d3e83c-99a6-49c3-83ef-174fd7fd567e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031754 Sep 19 12:39:07.533304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 493/978] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:39:08.416426 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-45eb1c2d-a2e8-4113-84cf-468637d22ad3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:08.416992 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-45eb1c2d-a2e8-4113-84cf-468637d22ad3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: bd7bbf9d-0062-431f-bc51-73c899732186] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:08.418948 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=2 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:39:08.419612 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=6 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:39:08.425625 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-45eb1c2d-a2e8-4113-84cf-468637d22ad3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:08.426132 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-45eb1c2d-a2e8-4113-84cf-468637d22ad3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:08.426550 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-45eb1c2d-a2e8-4113-84cf-468637d22ad3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:08.427244 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-45eb1c2d-a2e8-4113-84cf-468637d22ad3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:08.427692 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-45eb1c2d-a2e8-4113-84cf-468637d22ad3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:08.428118 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-45eb1c2d-a2e8-4113-84cf-468637d22ad3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:08.556501 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-45eb1c2d-a2e8-4113-84cf-468637d22ad3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:08.560191 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:39:08.564882 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-45eb1c2d-a2e8-4113-84cf-468637d22ad3 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186" status: 200 len: 1314 microversion: 2.1 time: 0.152415 Sep 19 12:39:08.567288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 486/979] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:08 2022] GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:39:09.585307 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=2 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:39:09.589953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-526b7855-4123-4407-a9ed-31eb6a297c20 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:09.590653 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-526b7855-4123-4407-a9ed-31eb6a297c20 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: bd7bbf9d-0062-431f-bc51-73c899732186] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:09.597762 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-526b7855-4123-4407-a9ed-31eb6a297c20 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:09.598248 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-526b7855-4123-4407-a9ed-31eb6a297c20 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:09.598716 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-526b7855-4123-4407-a9ed-31eb6a297c20 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:09.599408 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-526b7855-4123-4407-a9ed-31eb6a297c20 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:09.599878 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-526b7855-4123-4407-a9ed-31eb6a297c20 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:09.600289 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-526b7855-4123-4407-a9ed-31eb6a297c20 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:09.805846 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-526b7855-4123-4407-a9ed-31eb6a297c20 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:09.814046 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-526b7855-4123-4407-a9ed-31eb6a297c20 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186" status: 200 len: 1314 microversion: 2.1 time: 0.229843 Sep 19 12:39:09.814601 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 494/980] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:09 2022] GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:10.837855 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e3ecd31f-f1a4-4fa9-bc3c-e4eb6acee7db tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:10.838441 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e3ecd31f-f1a4-4fa9-bc3c-e4eb6acee7db tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: bd7bbf9d-0062-431f-bc51-73c899732186] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:10.840841 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:39:10.846231 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e3ecd31f-f1a4-4fa9-bc3c-e4eb6acee7db tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:10.846712 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e3ecd31f-f1a4-4fa9-bc3c-e4eb6acee7db tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:10.847173 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e3ecd31f-f1a4-4fa9-bc3c-e4eb6acee7db tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:10.847855 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e3ecd31f-f1a4-4fa9-bc3c-e4eb6acee7db tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:10.848303 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e3ecd31f-f1a4-4fa9-bc3c-e4eb6acee7db tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:10.848749 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e3ecd31f-f1a4-4fa9-bc3c-e4eb6acee7db tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:10.981495 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e3ecd31f-f1a4-4fa9-bc3c-e4eb6acee7db tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:10.989865 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e3ecd31f-f1a4-4fa9-bc3c-e4eb6acee7db tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186" status: 200 len: 1499 microversion: 2.1 time: 0.156205 Sep 19 12:39:10.990422 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 487/981] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:10 2022] GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186 => generated 1499 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:11.909155 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b6248393-0f70-4c84-bdff-39a703953bd4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:11.909719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b6248393-0f70-4c84-bdff-39a703953bd4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: bd7bbf9d-0062-431f-bc51-73c899732186] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:11.916388 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b6248393-0f70-4c84-bdff-39a703953bd4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:11.916942 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b6248393-0f70-4c84-bdff-39a703953bd4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:11.917384 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b6248393-0f70-4c84-bdff-39a703953bd4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:11.918092 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b6248393-0f70-4c84-bdff-39a703953bd4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:11.918550 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b6248393-0f70-4c84-bdff-39a703953bd4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:11.918993 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b6248393-0f70-4c84-bdff-39a703953bd4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:11.945300 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b6248393-0f70-4c84-bdff-39a703953bd4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: bd7bbf9d-0062-431f-bc51-73c899732186] Going to try to terminate instance {{(pid=121429) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:39:12.268021 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-b6248393-0f70-4c84-bdff-39a703953bd4 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186" status: 204 len: 0 microversion: 2.1 time: 0.362676 Sep 19 12:39:12.268652 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 495/982] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:39:11 2022] DELETE /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:39:12.276907 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e39a16e8-ce6e-4453-9cd5-1d33f21ff99e tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:12.277543 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e39a16e8-ce6e-4453-9cd5-1d33f21ff99e tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: bd7bbf9d-0062-431f-bc51-73c899732186] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:12.284774 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e39a16e8-ce6e-4453-9cd5-1d33f21ff99e tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:12.285274 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e39a16e8-ce6e-4453-9cd5-1d33f21ff99e tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:12.285697 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e39a16e8-ce6e-4453-9cd5-1d33f21ff99e tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:12.286394 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e39a16e8-ce6e-4453-9cd5-1d33f21ff99e tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:12.286844 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e39a16e8-ce6e-4453-9cd5-1d33f21ff99e tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:12.287270 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e39a16e8-ce6e-4453-9cd5-1d33f21ff99e tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:12.418046 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e39a16e8-ce6e-4453-9cd5-1d33f21ff99e tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:12.425754 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e39a16e8-ce6e-4453-9cd5-1d33f21ff99e tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186" status: 200 len: 1505 microversion: 2.1 time: 0.152755 Sep 19 12:39:12.426319 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 488/983] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:12 2022] GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:13.449590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c14ffc1c-86ee-497b-bd74-2fe3dc0eee14 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:13.450215 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c14ffc1c-86ee-497b-bd74-2fe3dc0eee14 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: bd7bbf9d-0062-431f-bc51-73c899732186] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:13.453105 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:39:13.457833 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c14ffc1c-86ee-497b-bd74-2fe3dc0eee14 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:13.458315 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c14ffc1c-86ee-497b-bd74-2fe3dc0eee14 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:13.458749 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c14ffc1c-86ee-497b-bd74-2fe3dc0eee14 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:13.459527 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c14ffc1c-86ee-497b-bd74-2fe3dc0eee14 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:13.459975 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c14ffc1c-86ee-497b-bd74-2fe3dc0eee14 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:13.460574 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c14ffc1c-86ee-497b-bd74-2fe3dc0eee14 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:13.595630 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c14ffc1c-86ee-497b-bd74-2fe3dc0eee14 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:13.603201 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c14ffc1c-86ee-497b-bd74-2fe3dc0eee14 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186" status: 200 len: 1505 microversion: 2.1 time: 0.157987 Sep 19 12:39:13.603761 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 496/984] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:13 2022] GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:14.264942 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-3a51d0c1-8692-4afe-9bdd-ad7e48bba372 req-2001275c-d4b8-4faf-ba83-37d6bcf05b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd7bbf9d-0062-431f-bc51-73c899732186", "name": "network-vif-deleted", "tag": "e57d730c-79e9-4379-8654-5f4f05701abb"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:39:14.274650 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-3a51d0c1-8692-4afe-9bdd-ad7e48bba372 req-2001275c-d4b8-4faf-ba83-37d6bcf05b98 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:14.275561 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-3a51d0c1-8692-4afe-9bdd-ad7e48bba372 req-2001275c-d4b8-4faf-ba83-37d6bcf05b98 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:14.275561 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-3a51d0c1-8692-4afe-9bdd-ad7e48bba372 req-2001275c-d4b8-4faf-ba83-37d6bcf05b98 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:14.287581 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-3a51d0c1-8692-4afe-9bdd-ad7e48bba372 req-2001275c-d4b8-4faf-ba83-37d6bcf05b98 service nova] Creating event network-vif-deleted:e57d730c-79e9-4379-8654-5f4f05701abb for instance bd7bbf9d-0062-431f-bc51-73c899732186 on hv-cinder-85061 Sep 19 12:39:14.292708 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-3a51d0c1-8692-4afe-9bdd-ad7e48bba372 req-2001275c-d4b8-4faf-ba83-37d6bcf05b98 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031615 Sep 19 12:39:14.293288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 489/985] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:39:14.625859 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-fc6e2b12-1aa1-4b7c-aa88-0eb6bb9db631 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:14.626766 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-fc6e2b12-1aa1-4b7c-aa88-0eb6bb9db631 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: bd7bbf9d-0062-431f-bc51-73c899732186] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:14.633400 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc6e2b12-1aa1-4b7c-aa88-0eb6bb9db631 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:14.633889 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc6e2b12-1aa1-4b7c-aa88-0eb6bb9db631 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:14.634323 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc6e2b12-1aa1-4b7c-aa88-0eb6bb9db631 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:14.635018 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc6e2b12-1aa1-4b7c-aa88-0eb6bb9db631 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:14.635471 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc6e2b12-1aa1-4b7c-aa88-0eb6bb9db631 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:14.635898 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc6e2b12-1aa1-4b7c-aa88-0eb6bb9db631 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:14.668271 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc6e2b12-1aa1-4b7c-aa88-0eb6bb9db631 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:14.668800 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc6e2b12-1aa1-4b7c-aa88-0eb6bb9db631 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:14.669247 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fc6e2b12-1aa1-4b7c-aa88-0eb6bb9db631 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:14.669724 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.objects.instance [None req-fc6e2b12-1aa1-4b7c-aa88-0eb6bb9db631 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lazy-loading 'fault' on Instance uuid bd7bbf9d-0062-431f-bc51-73c899732186 {{(pid=121429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:39:14.711244 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-fc6e2b12-1aa1-4b7c-aa88-0eb6bb9db631 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe84e2ed72343c8b8e787075efb1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bbe76fb2fe04cd391a40a4d9abe53f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:14.714580 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:39:14.719710 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-fc6e2b12-1aa1-4b7c-aa88-0eb6bb9db631 tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186" status: 200 len: 1304 microversion: 2.1 time: 0.097783 Sep 19 12:39:14.720265 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 497/986] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:14 2022] GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:15.745592 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-7d285a73-0dd8-428b-89d9-81d207105c6c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:15.746297 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-7d285a73-0dd8-428b-89d9-81d207105c6c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] [instance: bd7bbf9d-0062-431f-bc51-73c899732186] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:15.753311 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7d285a73-0dd8-428b-89d9-81d207105c6c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:15.753792 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7d285a73-0dd8-428b-89d9-81d207105c6c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:15.754230 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7d285a73-0dd8-428b-89d9-81d207105c6c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:15.754925 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7d285a73-0dd8-428b-89d9-81d207105c6c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:15.755373 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7d285a73-0dd8-428b-89d9-81d207105c6c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:15.755796 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7d285a73-0dd8-428b-89d9-81d207105c6c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:15.768963 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-7d285a73-0dd8-428b-89d9-81d207105c6c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] HTTP exception thrown: Instance bd7bbf9d-0062-431f-bc51-73c899732186 could not be found. Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-7d285a73-0dd8-428b-89d9-81d207105c6c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Request method failure captured: Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186 HTTP/1.1 Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKGLN1f9FchhPpZVXvq2x76VqNPKhQygmSyYnFZ2rrfYbgqvtlTXqHHs7XfzPmUtdMU6TFvlCgytd0f4Nh-h1pLQRk-PkDcxd42-pUZ10MGGx7ap7Rgs4ofEVpGf5mJSOlnBOeTXlqmJW5EBsgsYYKIBcL9gdABUzdatyHC6zj6co7F0 Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: 1bbe76fb2fe04cd391a40a4d9abe53f2 Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-VolumesActionsTest-919474340 Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:39:15.770613 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:39:15.772109 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1bbe76fb2fe04cd391a40a4d9abe53f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1bbe76fb2fe04cd391a40a4d9abe53f2", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1bbe76fb2fe04cd391a40a4d9abe53f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1bbe76fb2fe04cd391a40a4d9abe53f2"}]}] Sep 19 12:39:15.772109 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-VolumesActionsTest-919474340 Sep 19 12:39:15.772109 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: 1bbe76fb2fe04cd391a40a4d9abe53f2 Sep 19 12:39:15.772109 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-VolumesActionsTest-919474340 Sep 19 12:39:15.772109 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-VolumesActionsTest-919474340-project Sep 19 12:39:15.772109 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:39:15.772109 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:39:15.772109 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: 8fe84e2ed72343c8b8e787075efb1edd Sep 19 12:39:15.772109 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-VolumesActionsTest-919474340-project Sep 19 12:39:15.772109 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:39:15.772109 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance bd7bbf9d-0062-431f-bc51-73c899732186 could not be found. Sep 19 12:39:15.772109 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': 'bd7bbf9d-0062-431f-bc51-73c899732186'} Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd7bbf9d-0062-431f-bc51-73c899732186 could not be found. Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:39:15.773009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:39:15.774619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:39:15.774619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:39:15.774619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:39:15.774619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:39:15.774619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:39:15.774619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:39:15.774619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:39:15.774619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd7bbf9d-0062-431f-bc51-73c899732186 could not be found. Sep 19 12:39:15.774619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:39:15.774619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:39:15.774619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:39:15.774619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:39:15.774619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:39:15.774619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:39:15.774619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:39:15.774619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:39:15.774619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd7bbf9d-0062-431f-bc51-73c899732186 could not be found. Sep 19 12:39:15.774619 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:39:15.776175 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-7d285a73-0dd8-428b-89d9-81d207105c6c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] Returning 404 to user: Instance bd7bbf9d-0062-431f-bc51-73c899732186 could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:39:15.776175 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-7d285a73-0dd8-428b-89d9-81d207105c6c tempest-VolumesActionsTest-919474340 tempest-VolumesActionsTest-919474340-project] 10.222.0.93 "GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186" status: 404 len: 111 microversion: 2.1 time: 0.031235 Sep 19 12:39:15.776175 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 490/987] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:15 2022] GET /compute/v2.1/servers/bd7bbf9d-0062-431f-bc51-73c899732186 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:39:55.783871 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=5 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:39:55.968773 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-a9301011-7fe2-4c94-9a03-b1d2bb07e163 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Action: 'create', calling method: .version_select at 0x7f54b38d8040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1037177663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhUSm4JnhOMGbQnQhoHq7CU44529p+KZ6Vd84XiyzGmuybRECDtiQE4AY4b/hi+PqIbSpUqGXLty7dVaZN/qoHcnfCUxRYJjMxyf158CdyEhr67WWKjyRZgOERm2sgvyg=="}} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:39:55.987573 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-a9301011-7fe2-4c94-9a03-b1d2bb07e163 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Getting quotas for project 00cdacab5c564ab29d54ea189755adb0. Resources: {'key_pairs'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:39:55.991981 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.quota [None req-a9301011-7fe2-4c94-9a03-b1d2bb07e163 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Getting quotas for user 14737ebdbfe243cca926c7b02b0018a0 and project 00cdacab5c564ab29d54ea189755adb0. Resources: {'key_pairs'} {{(pid=121429) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:39:56.120226 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-a9301011-7fe2-4c94-9a03-b1d2bb07e163 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.341766 Sep 19 12:39:56.121068 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 498/988] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Sep 19 12:39:55 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:40:15.795411 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=7 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:40:15.796133 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=16 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:40:15.800027 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-4c15426c-3b78-4241-916d-a965e6345371 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:15.803214 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-4c15426c-3b78-4241-916d-a965e6345371 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:15.806271 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4c15426c-3b78-4241-916d-a965e6345371 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:15.806748 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4c15426c-3b78-4241-916d-a965e6345371 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:15.807178 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4c15426c-3b78-4241-916d-a965e6345371 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:15.808000 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4c15426c-3b78-4241-916d-a965e6345371 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:15.808447 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4c15426c-3b78-4241-916d-a965e6345371 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:15.808904 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4c15426c-3b78-4241-916d-a965e6345371 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:15.836455 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-4c15426c-3b78-4241-916d-a965e6345371 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Going to try to terminate instance {{(pid=121428) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:40:16.129789 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-4c15426c-3b78-4241-916d-a965e6345371 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 204 len: 0 microversion: 2.1 time: 0.335997 Sep 19 12:40:16.130381 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 491/989] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:40:15 2022] DELETE /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:40:16.138430 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-f9599450-0ad1-420a-84a9-1f5a5818f6f4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:16.139131 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-f9599450-0ad1-420a-84a9-1f5a5818f6f4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:16.141702 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=4 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:40:16.144186 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:40:16.147260 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f9599450-0ad1-420a-84a9-1f5a5818f6f4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:16.147746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f9599450-0ad1-420a-84a9-1f5a5818f6f4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:16.148223 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f9599450-0ad1-420a-84a9-1f5a5818f6f4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:16.148948 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f9599450-0ad1-420a-84a9-1f5a5818f6f4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:16.149401 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f9599450-0ad1-420a-84a9-1f5a5818f6f4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:16.149822 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f9599450-0ad1-420a-84a9-1f5a5818f6f4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:16.281292 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-f9599450-0ad1-420a-84a9-1f5a5818f6f4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:16.290133 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-f9599450-0ad1-420a-84a9-1f5a5818f6f4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1578 microversion: 2.1 time: 0.155552 Sep 19 12:40:16.290725 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 499/990] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:16 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:16.560007 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-cefa9e14-0a29-4b31-8bd6-69a51f56419e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-610685340", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1037177663", "security_groups": [{"name": "tempest-secgroup-smoke-623122912"}], "networks": [{"uuid": "4fb4d808-1cfa-41a7-9c7d-74e5dc234d2d"}], "block_device_mapping_v2": [{"uuid": "fcd8c2e6-0e9c-4ddc-9d4b-19cec8f4d0f1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:40:16.673205 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.network.neutron [None req-cefa9e14-0a29-4b31-8bd6-69a51f56419e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] validate_networks() for [('4fb4d808-1cfa-41a7-9c7d-74e5dc234d2d', None, None, None, None, None)] {{(pid=121428) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:40:17.039337 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-cefa9e14-0a29-4b31-8bd6-69a51f56419e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Flavor limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:40:17.039911 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-cefa9e14-0a29-4b31-8bd6-69a51f56419e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Image limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:40:17.040242 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-cefa9e14-0a29-4b31-8bd6-69a51f56419e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Flavor pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:40:17.040668 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-cefa9e14-0a29-4b31-8bd6-69a51f56419e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Image pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:40:17.041074 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-cefa9e14-0a29-4b31-8bd6-69a51f56419e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:40:17.049809 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cefa9e14-0a29-4b31-8bd6-69a51f56419e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:17.050286 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cefa9e14-0a29-4b31-8bd6-69a51f56419e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:17.050719 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cefa9e14-0a29-4b31-8bd6-69a51f56419e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:17.051436 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cefa9e14-0a29-4b31-8bd6-69a51f56419e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:17.051882 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cefa9e14-0a29-4b31-8bd6-69a51f56419e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:17.052301 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-cefa9e14-0a29-4b31-8bd6-69a51f56419e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:17.069365 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-cefa9e14-0a29-4b31-8bd6-69a51f56419e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Getting quotas for project 00cdacab5c564ab29d54ea189755adb0. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:40:17.073441 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-cefa9e14-0a29-4b31-8bd6-69a51f56419e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Getting quotas for user 14737ebdbfe243cca926c7b02b0018a0 and project 00cdacab5c564ab29d54ea189755adb0. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:40:17.130214 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-cefa9e14-0a29-4b31-8bd6-69a51f56419e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Going to run 1 instances... {{(pid=121428) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:40:17.132467 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-cefa9e14-0a29-4b31-8bd6-69a51f56419e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fcd8c2e6-0e9c-4ddc-9d4b-19cec8f4d0f1',volume_size=None,volume_type=None)] {{(pid=121428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:40:17.317818 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4a673d92-084a-410b-87cf-346b5a8ff2ca tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:17.318505 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4a673d92-084a-410b-87cf-346b5a8ff2ca tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:17.324171 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a673d92-084a-410b-87cf-346b5a8ff2ca tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:17.325940 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a673d92-084a-410b-87cf-346b5a8ff2ca tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:17.325940 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a673d92-084a-410b-87cf-346b5a8ff2ca tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:17.325940 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a673d92-084a-410b-87cf-346b5a8ff2ca tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:17.326342 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a673d92-084a-410b-87cf-346b5a8ff2ca tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:17.326708 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a673d92-084a-410b-87cf-346b5a8ff2ca tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:17.460406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-4a673d92-084a-410b-87cf-346b5a8ff2ca tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:17.468070 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4a673d92-084a-410b-87cf-346b5a8ff2ca tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1578 microversion: 2.1 time: 0.155252 Sep 19 12:40:17.468646 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 500/991] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:17 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:40:17.636508 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-cefa9e14-0a29-4b31-8bd6-69a51f56419e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.080733 Sep 19 12:40:17.637449 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 492/992] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:40:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:40:17.649063 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2f1267e6-8067-4ab1-acfa-6706f5a8f2f9 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:17.649671 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2f1267e6-8067-4ab1-acfa-6706f5a8f2f9 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:17.707088 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2f1267e6-8067-4ab1-acfa-6706f5a8f2f9 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:17.714923 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2f1267e6-8067-4ab1-acfa-6706f5a8f2f9 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1088 microversion: 2.1 time: 0.070286 Sep 19 12:40:17.715725 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 501/993] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:17 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1088 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:40:18.493141 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-68776f5c-03b8-4dff-8c41-926b84bf979f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:18.493141 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-68776f5c-03b8-4dff-8c41-926b84bf979f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:18.500172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-68776f5c-03b8-4dff-8c41-926b84bf979f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:18.500695 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-68776f5c-03b8-4dff-8c41-926b84bf979f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:18.501137 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-68776f5c-03b8-4dff-8c41-926b84bf979f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:18.501832 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-68776f5c-03b8-4dff-8c41-926b84bf979f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:18.502314 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-68776f5c-03b8-4dff-8c41-926b84bf979f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:18.502743 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-68776f5c-03b8-4dff-8c41-926b84bf979f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:18.682206 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-68776f5c-03b8-4dff-8c41-926b84bf979f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:18.690323 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-68776f5c-03b8-4dff-8c41-926b84bf979f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1578 microversion: 2.1 time: 0.202802 Sep 19 12:40:18.695017 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 493/994] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:18 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1578 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:18.737633 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b962d4f1-5fa9-4b2f-9cfc-830eaeffdbb0 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:18.738268 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b962d4f1-5fa9-4b2f-9cfc-830eaeffdbb0 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:18.791542 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-b962d4f1-5fa9-4b2f-9cfc-830eaeffdbb0 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:18.799736 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-b962d4f1-5fa9-4b2f-9cfc-830eaeffdbb0 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1088 microversion: 2.1 time: 0.065940 Sep 19 12:40:18.800302 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 502/995] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:18 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:19.100591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-70777e3e-806e-4a10-925e-772057b9c238 req-09759bfb-811c-4046-b20c-9f1cc323c687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e74d99e-308c-42c2-b0e4-41a594c0db6a", "name": "network-vif-deleted", "tag": "ab201db2-b696-4cee-915b-c71cf380b91d"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:40:19.110301 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-70777e3e-806e-4a10-925e-772057b9c238 req-09759bfb-811c-4046-b20c-9f1cc323c687 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:19.113638 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-70777e3e-806e-4a10-925e-772057b9c238 req-09759bfb-811c-4046-b20c-9f1cc323c687 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:19.113638 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-70777e3e-806e-4a10-925e-772057b9c238 req-09759bfb-811c-4046-b20c-9f1cc323c687 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:19.122236 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-70777e3e-806e-4a10-925e-772057b9c238 req-09759bfb-811c-4046-b20c-9f1cc323c687 service nova] Creating event network-vif-deleted:ab201db2-b696-4cee-915b-c71cf380b91d for instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a on hv-cinder-85061 Sep 19 12:40:19.127857 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-70777e3e-806e-4a10-925e-772057b9c238 req-09759bfb-811c-4046-b20c-9f1cc323c687 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030938 Sep 19 12:40:19.128474 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 494/996] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:40:19.716094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-1c313b70-47f5-4e78-a4db-880fe8c8b600 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:19.718363 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-1c313b70-47f5-4e78-a4db-880fe8c8b600 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:19.728488 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c313b70-47f5-4e78-a4db-880fe8c8b600 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:19.729588 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c313b70-47f5-4e78-a4db-880fe8c8b600 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:19.730341 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c313b70-47f5-4e78-a4db-880fe8c8b600 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:19.732411 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c313b70-47f5-4e78-a4db-880fe8c8b600 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:19.743171 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c313b70-47f5-4e78-a4db-880fe8c8b600 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:19.745156 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c313b70-47f5-4e78-a4db-880fe8c8b600 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:19.782335 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c313b70-47f5-4e78-a4db-880fe8c8b600 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:19.782829 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c313b70-47f5-4e78-a4db-880fe8c8b600 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:19.783267 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c313b70-47f5-4e78-a4db-880fe8c8b600 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:19.783721 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.objects.instance [None req-1c313b70-47f5-4e78-a4db-880fe8c8b600 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lazy-loading 'fault' on Instance uuid 8e74d99e-308c-42c2-b0e4-41a594c0db6a {{(pid=121429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:40:19.824713 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d82726f6-4521-4cfe-99db-8e3e1e6088f8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:19.826059 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d82726f6-4521-4cfe-99db-8e3e1e6088f8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:19.831405 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-1c313b70-47f5-4e78-a4db-880fe8c8b600 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:19.832385 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d82726f6-4521-4cfe-99db-8e3e1e6088f8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:19.835419 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d82726f6-4521-4cfe-99db-8e3e1e6088f8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:19.835419 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d82726f6-4521-4cfe-99db-8e3e1e6088f8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:19.835419 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d82726f6-4521-4cfe-99db-8e3e1e6088f8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:19.835419 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d82726f6-4521-4cfe-99db-8e3e1e6088f8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:19.835897 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d82726f6-4521-4cfe-99db-8e3e1e6088f8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:19.840378 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-1c313b70-47f5-4e78-a4db-880fe8c8b600 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1231 microversion: 2.1 time: 0.129234 Sep 19 12:40:19.841125 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 503/997] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:19 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1231 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:20.168915 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-d82726f6-4521-4cfe-99db-8e3e1e6088f8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:20.183096 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d82726f6-4521-4cfe-99db-8e3e1e6088f8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1186 microversion: 2.1 time: 0.360017 Sep 19 12:40:20.183096 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 495/998] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:19 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1186 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:40:20.866371 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c1b98e93-86a8-4c1b-a98f-82e6b1c101a8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:20.867188 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c1b98e93-86a8-4c1b-a98f-82e6b1c101a8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:20.874553 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1b98e93-86a8-4c1b-a98f-82e6b1c101a8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:20.875391 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1b98e93-86a8-4c1b-a98f-82e6b1c101a8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:20.876264 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1b98e93-86a8-4c1b-a98f-82e6b1c101a8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:20.876950 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1b98e93-86a8-4c1b-a98f-82e6b1c101a8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:20.877570 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1b98e93-86a8-4c1b-a98f-82e6b1c101a8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:20.878049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1b98e93-86a8-4c1b-a98f-82e6b1c101a8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:20.916386 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1b98e93-86a8-4c1b-a98f-82e6b1c101a8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:20.917298 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1b98e93-86a8-4c1b-a98f-82e6b1c101a8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:20.922935 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c1b98e93-86a8-4c1b-a98f-82e6b1c101a8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:20.922935 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.objects.instance [None req-c1b98e93-86a8-4c1b-a98f-82e6b1c101a8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lazy-loading 'fault' on Instance uuid 8e74d99e-308c-42c2-b0e4-41a594c0db6a {{(pid=121429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:40:21.004644 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c1b98e93-86a8-4c1b-a98f-82e6b1c101a8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:21.012178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c1b98e93-86a8-4c1b-a98f-82e6b1c101a8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 200 len: 1185 microversion: 2.1 time: 0.150496 Sep 19 12:40:21.027313 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 504/999] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:20 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 1185 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:21.203497 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-6cf1b002-6998-4884-9678-ac8be2a7236f tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:21.204120 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6cf1b002-6998-4884-9678-ac8be2a7236f tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:21.210568 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6cf1b002-6998-4884-9678-ac8be2a7236f tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:21.211052 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6cf1b002-6998-4884-9678-ac8be2a7236f tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:21.211492 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6cf1b002-6998-4884-9678-ac8be2a7236f tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:21.212189 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6cf1b002-6998-4884-9678-ac8be2a7236f tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:21.212673 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6cf1b002-6998-4884-9678-ac8be2a7236f tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:21.213102 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6cf1b002-6998-4884-9678-ac8be2a7236f tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:21.280973 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-6cf1b002-6998-4884-9678-ac8be2a7236f tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:21.289189 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-6cf1b002-6998-4884-9678-ac8be2a7236f tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1204 microversion: 2.1 time: 0.089654 Sep 19 12:40:21.290116 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 496/1000] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:21 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1204 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:22.035851 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-376e20d0-918c-49ea-be55-bb49b29df584 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:22.037013 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-376e20d0-918c-49ea-be55-bb49b29df584 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:22.043498 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-376e20d0-918c-49ea-be55-bb49b29df584 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:22.043979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-376e20d0-918c-49ea-be55-bb49b29df584 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:22.044420 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-376e20d0-918c-49ea-be55-bb49b29df584 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:22.045152 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-376e20d0-918c-49ea-be55-bb49b29df584 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:22.045610 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-376e20d0-918c-49ea-be55-bb49b29df584 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:22.046036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-376e20d0-918c-49ea-be55-bb49b29df584 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:22.060181 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-376e20d0-918c-49ea-be55-bb49b29df584 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] HTTP exception thrown: Instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a could not be found. Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-376e20d0-918c-49ea-be55-bb49b29df584 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Request method failure captured: Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a HTTP/1.1 Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKGKFQselOfs1QEh-qTYPIrguOyCEeD2fZGLo2RFYh96s4MStrL1_qQqjEiHcriSmkJJYo_SyMt1dtqARwwnD84hn7DksaiKUNFcNLb8JLHO29J88PcTEbHKrN61MB-6KO0gHe_tVkXUMLM1MLYv7aEmfnY463-JIOWVZeBqGxZYItF4 Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: ea2bd5c94eb7415c80a4e24452c08eb4 Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-TestVolumeBootPattern-452559673 Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:40:22.061854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:40:22.065657 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ea2bd5c94eb7415c80a4e24452c08eb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ea2bd5c94eb7415c80a4e24452c08eb4", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ea2bd5c94eb7415c80a4e24452c08eb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ea2bd5c94eb7415c80a4e24452c08eb4"}]}] Sep 19 12:40:22.065657 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-TestVolumeBootPattern-452559673 Sep 19 12:40:22.065657 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: ea2bd5c94eb7415c80a4e24452c08eb4 Sep 19 12:40:22.065657 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-TestVolumeBootPattern-452559673 Sep 19 12:40:22.065657 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-TestVolumeBootPattern-452559673-project Sep 19 12:40:22.065657 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:40:22.065657 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:40:22.065657 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 88b8a34360fa4595a07c7d3610563b77 Sep 19 12:40:22.065657 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-TestVolumeBootPattern-452559673-project Sep 19 12:40:22.065657 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:40:22.065657 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a could not be found. Sep 19 12:40:22.065657 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': '8e74d99e-308c-42c2-b0e4-41a594c0db6a'} Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a could not be found. Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:40:22.066730 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:40:22.068445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:40:22.068445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:40:22.068445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:40:22.068445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:40:22.068445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:40:22.068445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:40:22.068445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:40:22.068445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a could not be found. Sep 19 12:40:22.068445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:40:22.068445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:40:22.068445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:40:22.068445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:40:22.068445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:40:22.068445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:40:22.068445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:40:22.068445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:40:22.068445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a could not be found. Sep 19 12:40:22.068445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:40:22.070109 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-376e20d0-918c-49ea-be55-bb49b29df584 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Returning 404 to user: Instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:40:22.070109 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-376e20d0-918c-49ea-be55-bb49b29df584 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 404 len: 111 microversion: 2.1 time: 0.031361 Sep 19 12:40:22.070109 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 505/1001] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:22 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:40:22.167739 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8dd3952f-473e-4fe2-9006-836bc9874ee3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-555782201", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1129654240", "security_groups": [{"name": "tempest-secgroup-smoke-1134905487"}], "block_device_mapping_v2": [{"uuid": "7f17a61c-1978-4874-b43f-0177a09ddebb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e6b353e9-72f5-45ca-9fc7-16de881dafaf"}]}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:40:22.313437 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3e2bb67b-2398-4e09-841b-7eefdf90df35 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:22.314210 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3e2bb67b-2398-4e09-841b-7eefdf90df35 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:22.322310 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3e2bb67b-2398-4e09-841b-7eefdf90df35 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:22.322866 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3e2bb67b-2398-4e09-841b-7eefdf90df35 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:22.323524 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3e2bb67b-2398-4e09-841b-7eefdf90df35 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:22.324285 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3e2bb67b-2398-4e09-841b-7eefdf90df35 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:22.324845 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3e2bb67b-2398-4e09-841b-7eefdf90df35 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:22.325350 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3e2bb67b-2398-4e09-841b-7eefdf90df35 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:22.337292 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.network.neutron [None req-8dd3952f-473e-4fe2-9006-836bc9874ee3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] validate_networks() for [('e6b353e9-72f5-45ca-9fc7-16de881dafaf', None, None, None, None, None)] {{(pid=121428) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:40:22.597837 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3e2bb67b-2398-4e09-841b-7eefdf90df35 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:22.605919 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3e2bb67b-2398-4e09-841b-7eefdf90df35 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1271 microversion: 2.1 time: 0.297729 Sep 19 12:40:22.606494 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 506/1002] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:22 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1271 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:22.806109 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-ca4f7d2d-ada0-421a-a541-dbb52741b037 req-69f3bc41-2aa3-45da-92b8-1559b34c1873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e0ba5ed-539d-4219-8066-bed154fc37f0", "tag": "b8557e4d-5a65-4fe0-94ef-88821e1bd60d"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:40:22.817185 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-ca4f7d2d-ada0-421a-a541-dbb52741b037 req-69f3bc41-2aa3-45da-92b8-1559b34c1873 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:22.817185 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-ca4f7d2d-ada0-421a-a541-dbb52741b037 req-69f3bc41-2aa3-45da-92b8-1559b34c1873 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:22.817515 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-ca4f7d2d-ada0-421a-a541-dbb52741b037 req-69f3bc41-2aa3-45da-92b8-1559b34c1873 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:22.830046 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-ca4f7d2d-ada0-421a-a541-dbb52741b037 req-69f3bc41-2aa3-45da-92b8-1559b34c1873 service nova] Creating event network-changed:b8557e4d-5a65-4fe0-94ef-88821e1bd60d for instance 9e0ba5ed-539d-4219-8066-bed154fc37f0 on hv-cinder-85061 Sep 19 12:40:22.835813 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-ca4f7d2d-ada0-421a-a541-dbb52741b037 req-69f3bc41-2aa3-45da-92b8-1559b34c1873 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033418 Sep 19 12:40:22.837171 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 507/1003] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:40:22.975734 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-8dd3952f-473e-4fe2-9006-836bc9874ee3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Flavor limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:40:22.976156 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-8dd3952f-473e-4fe2-9006-836bc9874ee3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Image limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:40:22.976693 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-8dd3952f-473e-4fe2-9006-836bc9874ee3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Flavor pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:40:22.977106 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-8dd3952f-473e-4fe2-9006-836bc9874ee3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Image pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:40:22.977513 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-8dd3952f-473e-4fe2-9006-836bc9874ee3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:40:22.987095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8dd3952f-473e-4fe2-9006-836bc9874ee3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:22.987582 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8dd3952f-473e-4fe2-9006-836bc9874ee3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:22.988033 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8dd3952f-473e-4fe2-9006-836bc9874ee3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:22.988900 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8dd3952f-473e-4fe2-9006-836bc9874ee3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:22.989561 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8dd3952f-473e-4fe2-9006-836bc9874ee3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:22.989989 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-8dd3952f-473e-4fe2-9006-836bc9874ee3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:23.007675 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-8dd3952f-473e-4fe2-9006-836bc9874ee3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Getting quotas for project ea2bd5c94eb7415c80a4e24452c08eb4. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:40:23.011647 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-8dd3952f-473e-4fe2-9006-836bc9874ee3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Getting quotas for user 88b8a34360fa4595a07c7d3610563b77 and project ea2bd5c94eb7415c80a4e24452c08eb4. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:40:23.069065 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-8dd3952f-473e-4fe2-9006-836bc9874ee3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Going to run 1 instances... {{(pid=121428) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:40:23.071168 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-8dd3952f-473e-4fe2-9006-836bc9874ee3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f17a61c-1978-4874-b43f-0177a09ddebb',volume_size=None,volume_type=None)] {{(pid=121428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:40:23.623590 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8dd3952f-473e-4fe2-9006-836bc9874ee3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.460195 Sep 19 12:40:23.624502 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 497/1004] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:40:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:40:23.630460 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-5a77f65b-cb10-4552-8a69-a1a29711b286 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:23.632100 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-5a77f65b-cb10-4552-8a69-a1a29711b286 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:23.635866 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b3fff243-8532-4e03-bf52-b9f578607ca9 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:23.636569 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-b3fff243-8532-4e03-bf52-b9f578607ca9 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:23.640021 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5a77f65b-cb10-4552-8a69-a1a29711b286 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:23.654179 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5a77f65b-cb10-4552-8a69-a1a29711b286 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:23.654179 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5a77f65b-cb10-4552-8a69-a1a29711b286 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:23.654179 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5a77f65b-cb10-4552-8a69-a1a29711b286 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:23.654179 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5a77f65b-cb10-4552-8a69-a1a29711b286 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:23.655460 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-5a77f65b-cb10-4552-8a69-a1a29711b286 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:23.695050 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-b3fff243-8532-4e03-bf52-b9f578607ca9 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:23.703715 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-b3fff243-8532-4e03-bf52-b9f578607ca9 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1094 microversion: 2.1 time: 0.071771 Sep 19 12:40:23.707992 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 498/1005] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:23 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:23.798611 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-5a77f65b-cb10-4552-8a69-a1a29711b286 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:23.807128 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-5a77f65b-cb10-4552-8a69-a1a29711b286 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1259 microversion: 2.1 time: 0.180880 Sep 19 12:40:23.807691 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 508/1006] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:23 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:24.730685 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-7f8f603e-8d84-429a-8143-2fcdc004e508 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:24.731296 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-7f8f603e-8d84-429a-8143-2fcdc004e508 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:24.738298 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7f8f603e-8d84-429a-8143-2fcdc004e508 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:24.738782 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7f8f603e-8d84-429a-8143-2fcdc004e508 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:24.739739 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7f8f603e-8d84-429a-8143-2fcdc004e508 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:24.740429 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7f8f603e-8d84-429a-8143-2fcdc004e508 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:24.740894 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7f8f603e-8d84-429a-8143-2fcdc004e508 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:24.741313 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-7f8f603e-8d84-429a-8143-2fcdc004e508 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:24.803610 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-7f8f603e-8d84-429a-8143-2fcdc004e508 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:24.811156 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-7f8f603e-8d84-429a-8143-2fcdc004e508 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1144 microversion: 2.1 time: 0.084398 Sep 19 12:40:24.811715 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 499/1007] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:24 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:24.830653 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-55f62807-00bb-40b2-a6c9-4396ffd17f90 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:24.831200 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-55f62807-00bb-40b2-a6c9-4396ffd17f90 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:24.837640 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-55f62807-00bb-40b2-a6c9-4396ffd17f90 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:24.838126 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-55f62807-00bb-40b2-a6c9-4396ffd17f90 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:24.838597 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-55f62807-00bb-40b2-a6c9-4396ffd17f90 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:24.839295 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-55f62807-00bb-40b2-a6c9-4396ffd17f90 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:24.839749 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-55f62807-00bb-40b2-a6c9-4396ffd17f90 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:24.840177 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-55f62807-00bb-40b2-a6c9-4396ffd17f90 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:24.975024 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-55f62807-00bb-40b2-a6c9-4396ffd17f90 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:24.982951 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-55f62807-00bb-40b2-a6c9-4396ffd17f90 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1259 microversion: 2.1 time: 0.156309 Sep 19 12:40:24.983680 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 509/1008] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:24 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:25.833621 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-68355057-de55-4d99-be9a-f164a231d24b tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:25.834830 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-68355057-de55-4d99-be9a-f164a231d24b tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:25.841329 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-68355057-de55-4d99-be9a-f164a231d24b tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:25.841801 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-68355057-de55-4d99-be9a-f164a231d24b tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:25.842230 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-68355057-de55-4d99-be9a-f164a231d24b tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:25.842948 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-68355057-de55-4d99-be9a-f164a231d24b tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:25.843391 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-68355057-de55-4d99-be9a-f164a231d24b tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:25.843808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-68355057-de55-4d99-be9a-f164a231d24b tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:25.905212 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-68355057-de55-4d99-be9a-f164a231d24b tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:25.913389 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-68355057-de55-4d99-be9a-f164a231d24b tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1192 microversion: 2.1 time: 0.083568 Sep 19 12:40:25.918076 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 500/1009] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:25 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:26.007528 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-bc018fd3-f528-4a51-84ea-59952dea70b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:26.009864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-bc018fd3-f528-4a51-84ea-59952dea70b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:26.014442 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bc018fd3-f528-4a51-84ea-59952dea70b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:26.014928 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bc018fd3-f528-4a51-84ea-59952dea70b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:26.015509 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bc018fd3-f528-4a51-84ea-59952dea70b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:26.016217 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bc018fd3-f528-4a51-84ea-59952dea70b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:26.016687 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bc018fd3-f528-4a51-84ea-59952dea70b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:26.017112 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-bc018fd3-f528-4a51-84ea-59952dea70b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:26.227642 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-bc018fd3-f528-4a51-84ea-59952dea70b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:26.235431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-bc018fd3-f528-4a51-84ea-59952dea70b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1259 microversion: 2.1 time: 0.233003 Sep 19 12:40:26.236113 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 510/1010] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:26 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:26.937953 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d931ee8a-e9f6-4431-be60-6cfe9ab54d3d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:26.938803 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d931ee8a-e9f6-4431-be60-6cfe9ab54d3d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:26.946084 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d931ee8a-e9f6-4431-be60-6cfe9ab54d3d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:26.946568 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d931ee8a-e9f6-4431-be60-6cfe9ab54d3d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:26.947009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d931ee8a-e9f6-4431-be60-6cfe9ab54d3d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:26.947724 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d931ee8a-e9f6-4431-be60-6cfe9ab54d3d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:26.948177 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d931ee8a-e9f6-4431-be60-6cfe9ab54d3d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:26.948642 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d931ee8a-e9f6-4431-be60-6cfe9ab54d3d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:27.160074 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-d931ee8a-e9f6-4431-be60-6cfe9ab54d3d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:27.165037 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d931ee8a-e9f6-4431-be60-6cfe9ab54d3d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1278 microversion: 2.1 time: 0.231535 Sep 19 12:40:27.165476 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 501/1011] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:26 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1278 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:27.258957 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-86e49afc-453b-4300-b132-7882851d1087 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:27.259594 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-86e49afc-453b-4300-b132-7882851d1087 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:27.266277 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-86e49afc-453b-4300-b132-7882851d1087 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:27.266757 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-86e49afc-453b-4300-b132-7882851d1087 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:27.269884 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-86e49afc-453b-4300-b132-7882851d1087 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:27.269884 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-86e49afc-453b-4300-b132-7882851d1087 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:27.269884 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-86e49afc-453b-4300-b132-7882851d1087 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:27.269884 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-86e49afc-453b-4300-b132-7882851d1087 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:27.472482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-86e49afc-453b-4300-b132-7882851d1087 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:27.481063 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-86e49afc-453b-4300-b132-7882851d1087 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1259 microversion: 2.1 time: 0.226610 Sep 19 12:40:27.481694 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 511/1012] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:27 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:28.010647 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-cc24b4ad-067f-4967-b37a-72d9a1256c01 req-3b77bea1-e59b-4993-a576-1000ba62c038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5c59bf-6037-4a1c-b6be-bd677f066903", "tag": "92a0d280-ad6f-4cdd-958b-f758f5800ced"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:40:28.020921 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-cc24b4ad-067f-4967-b37a-72d9a1256c01 req-3b77bea1-e59b-4993-a576-1000ba62c038 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:28.022193 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-cc24b4ad-067f-4967-b37a-72d9a1256c01 req-3b77bea1-e59b-4993-a576-1000ba62c038 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:28.022626 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-cc24b4ad-067f-4967-b37a-72d9a1256c01 req-3b77bea1-e59b-4993-a576-1000ba62c038 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:28.034269 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-cc24b4ad-067f-4967-b37a-72d9a1256c01 req-3b77bea1-e59b-4993-a576-1000ba62c038 service nova] Creating event network-changed:92a0d280-ad6f-4cdd-958b-f758f5800ced for instance 0e5c59bf-6037-4a1c-b6be-bd677f066903 on hv-cinder-85061 Sep 19 12:40:28.039148 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-cc24b4ad-067f-4967-b37a-72d9a1256c01 req-3b77bea1-e59b-4993-a576-1000ba62c038 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033908 Sep 19 12:40:28.039747 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 502/1013] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:40:28.190317 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-84da4982-c96d-4e8e-b246-88c62b569c9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:28.192177 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-84da4982-c96d-4e8e-b246-88c62b569c9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:28.198002 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-84da4982-c96d-4e8e-b246-88c62b569c9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:28.198585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-84da4982-c96d-4e8e-b246-88c62b569c9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:28.199481 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-84da4982-c96d-4e8e-b246-88c62b569c9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:28.199732 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-84da4982-c96d-4e8e-b246-88c62b569c9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:28.200362 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-84da4982-c96d-4e8e-b246-88c62b569c9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:28.200797 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-84da4982-c96d-4e8e-b246-88c62b569c9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:28.401650 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-84da4982-c96d-4e8e-b246-88c62b569c9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:28.409339 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-84da4982-c96d-4e8e-b246-88c62b569c9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1266 microversion: 2.1 time: 0.223171 Sep 19 12:40:28.409939 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 512/1014] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:28 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:28.506864 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-338d9b54-afee-4981-83af-e8b1e43b8f76 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:28.507601 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-338d9b54-afee-4981-83af-e8b1e43b8f76 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:28.513754 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-338d9b54-afee-4981-83af-e8b1e43b8f76 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:28.514232 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-338d9b54-afee-4981-83af-e8b1e43b8f76 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:28.514736 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-338d9b54-afee-4981-83af-e8b1e43b8f76 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:28.515348 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-338d9b54-afee-4981-83af-e8b1e43b8f76 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:28.515822 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-338d9b54-afee-4981-83af-e8b1e43b8f76 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:28.516317 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-338d9b54-afee-4981-83af-e8b1e43b8f76 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:28.721637 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-338d9b54-afee-4981-83af-e8b1e43b8f76 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:28.729569 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-338d9b54-afee-4981-83af-e8b1e43b8f76 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1259 microversion: 2.1 time: 0.227780 Sep 19 12:40:28.730271 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 503/1015] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:28 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:29.433169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-8dbd263e-5ce7-47d0-82df-e2effbebcd9c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:29.433704 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-8dbd263e-5ce7-47d0-82df-e2effbebcd9c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:29.435622 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=4 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:40:29.440846 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8dbd263e-5ce7-47d0-82df-e2effbebcd9c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:29.447372 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8dbd263e-5ce7-47d0-82df-e2effbebcd9c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:29.447372 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8dbd263e-5ce7-47d0-82df-e2effbebcd9c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:29.447372 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8dbd263e-5ce7-47d0-82df-e2effbebcd9c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:29.447372 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8dbd263e-5ce7-47d0-82df-e2effbebcd9c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:29.447754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8dbd263e-5ce7-47d0-82df-e2effbebcd9c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:29.575637 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8dbd263e-5ce7-47d0-82df-e2effbebcd9c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:29.583443 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-8dbd263e-5ce7-47d0-82df-e2effbebcd9c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1266 microversion: 2.1 time: 0.154221 Sep 19 12:40:29.584052 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 513/1016] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:29 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:29.752881 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-64dcd1ce-ac9e-4c32-b661-249230114e64 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:29.753451 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-64dcd1ce-ac9e-4c32-b661-249230114e64 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:29.759907 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-64dcd1ce-ac9e-4c32-b661-249230114e64 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:29.760391 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-64dcd1ce-ac9e-4c32-b661-249230114e64 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:29.760859 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-64dcd1ce-ac9e-4c32-b661-249230114e64 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:29.761617 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-64dcd1ce-ac9e-4c32-b661-249230114e64 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:29.762068 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-64dcd1ce-ac9e-4c32-b661-249230114e64 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:29.762501 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-64dcd1ce-ac9e-4c32-b661-249230114e64 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:29.890607 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-64dcd1ce-ac9e-4c32-b661-249230114e64 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:29.898516 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-64dcd1ce-ac9e-4c32-b661-249230114e64 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1259 microversion: 2.1 time: 0.149997 Sep 19 12:40:29.899085 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 504/1017] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:29 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:30.606477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2d4355af-59b7-450f-90bb-c6fc6014fb4e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:30.607088 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2d4355af-59b7-450f-90bb-c6fc6014fb4e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:30.613486 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2d4355af-59b7-450f-90bb-c6fc6014fb4e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:30.613968 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2d4355af-59b7-450f-90bb-c6fc6014fb4e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:30.614403 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2d4355af-59b7-450f-90bb-c6fc6014fb4e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:30.615092 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2d4355af-59b7-450f-90bb-c6fc6014fb4e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:30.615542 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2d4355af-59b7-450f-90bb-c6fc6014fb4e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:30.615972 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2d4355af-59b7-450f-90bb-c6fc6014fb4e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:30.742978 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2d4355af-59b7-450f-90bb-c6fc6014fb4e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:30.750874 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2d4355af-59b7-450f-90bb-c6fc6014fb4e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1266 microversion: 2.1 time: 0.148299 Sep 19 12:40:30.751438 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 514/1018] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:30 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:30.920921 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-705c8bc9-a695-49db-a87a-51d17ac67df3 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:30.921454 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-705c8bc9-a695-49db-a87a-51d17ac67df3 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:30.927764 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-705c8bc9-a695-49db-a87a-51d17ac67df3 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:30.928237 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-705c8bc9-a695-49db-a87a-51d17ac67df3 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:30.928696 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-705c8bc9-a695-49db-a87a-51d17ac67df3 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:30.929430 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-705c8bc9-a695-49db-a87a-51d17ac67df3 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:30.929891 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-705c8bc9-a695-49db-a87a-51d17ac67df3 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:30.930308 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-705c8bc9-a695-49db-a87a-51d17ac67df3 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:31.061783 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-705c8bc9-a695-49db-a87a-51d17ac67df3 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:31.069525 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-705c8bc9-a695-49db-a87a-51d17ac67df3 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1259 microversion: 2.1 time: 0.152564 Sep 19 12:40:31.070588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 505/1019] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:30 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:31.772840 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-548246a2-517b-44ab-ab02-424d325027b1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:31.773445 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-548246a2-517b-44ab-ab02-424d325027b1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:31.779835 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-548246a2-517b-44ab-ab02-424d325027b1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:31.780308 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-548246a2-517b-44ab-ab02-424d325027b1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:31.780772 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-548246a2-517b-44ab-ab02-424d325027b1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:31.781451 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-548246a2-517b-44ab-ab02-424d325027b1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:31.781897 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-548246a2-517b-44ab-ab02-424d325027b1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:31.782314 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-548246a2-517b-44ab-ab02-424d325027b1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:31.918174 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-548246a2-517b-44ab-ab02-424d325027b1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:31.925777 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-548246a2-517b-44ab-ab02-424d325027b1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1266 microversion: 2.1 time: 0.156850 Sep 19 12:40:31.926337 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 515/1020] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:31 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:32.093229 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c6eae2ff-865b-4ba1-95ea-272aa714f508 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:32.093839 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c6eae2ff-865b-4ba1-95ea-272aa714f508 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:32.100346 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c6eae2ff-865b-4ba1-95ea-272aa714f508 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:32.100859 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c6eae2ff-865b-4ba1-95ea-272aa714f508 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:32.101284 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c6eae2ff-865b-4ba1-95ea-272aa714f508 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:32.102757 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c6eae2ff-865b-4ba1-95ea-272aa714f508 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:32.103195 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c6eae2ff-865b-4ba1-95ea-272aa714f508 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:32.103641 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c6eae2ff-865b-4ba1-95ea-272aa714f508 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:32.239388 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c6eae2ff-865b-4ba1-95ea-272aa714f508 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:32.247177 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c6eae2ff-865b-4ba1-95ea-272aa714f508 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1259 microversion: 2.1 time: 0.158056 Sep 19 12:40:32.247761 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 506/1021] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:32 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:32.949764 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-6930cc04-79ce-4742-9c4d-468751831454 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:32.950391 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-6930cc04-79ce-4742-9c4d-468751831454 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:32.956829 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6930cc04-79ce-4742-9c4d-468751831454 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:32.957316 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6930cc04-79ce-4742-9c4d-468751831454 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:32.957756 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6930cc04-79ce-4742-9c4d-468751831454 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:32.958454 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6930cc04-79ce-4742-9c4d-468751831454 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:32.958912 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6930cc04-79ce-4742-9c4d-468751831454 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:32.959339 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6930cc04-79ce-4742-9c4d-468751831454 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:33.087431 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-6930cc04-79ce-4742-9c4d-468751831454 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:33.095118 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-6930cc04-79ce-4742-9c4d-468751831454 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1266 microversion: 2.1 time: 0.149856 Sep 19 12:40:33.095691 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 516/1022] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:32 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:33.270180 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-1afaa127-c7ff-4df7-b0aa-76be8e6df4a8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:33.270785 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-1afaa127-c7ff-4df7-b0aa-76be8e6df4a8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:33.272768 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=4 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:40:33.277952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1afaa127-c7ff-4df7-b0aa-76be8e6df4a8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:33.278497 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1afaa127-c7ff-4df7-b0aa-76be8e6df4a8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:33.278927 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1afaa127-c7ff-4df7-b0aa-76be8e6df4a8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:33.279608 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1afaa127-c7ff-4df7-b0aa-76be8e6df4a8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:33.280081 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1afaa127-c7ff-4df7-b0aa-76be8e6df4a8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:33.280499 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1afaa127-c7ff-4df7-b0aa-76be8e6df4a8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:33.411768 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-1afaa127-c7ff-4df7-b0aa-76be8e6df4a8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:33.419889 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-1afaa127-c7ff-4df7-b0aa-76be8e6df4a8 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1259 microversion: 2.1 time: 0.153625 Sep 19 12:40:33.420452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 507/1023] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:33 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:34.118311 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-94a46524-1cf4-4bf9-8398-faeed0d131db tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:34.118913 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-94a46524-1cf4-4bf9-8398-faeed0d131db tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:34.125533 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-94a46524-1cf4-4bf9-8398-faeed0d131db tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:34.126010 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-94a46524-1cf4-4bf9-8398-faeed0d131db tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:34.126443 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-94a46524-1cf4-4bf9-8398-faeed0d131db tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:34.127130 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-94a46524-1cf4-4bf9-8398-faeed0d131db tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:34.127577 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-94a46524-1cf4-4bf9-8398-faeed0d131db tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:34.128000 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-94a46524-1cf4-4bf9-8398-faeed0d131db tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:34.259021 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-94a46524-1cf4-4bf9-8398-faeed0d131db tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:34.266670 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-94a46524-1cf4-4bf9-8398-faeed0d131db tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1266 microversion: 2.1 time: 0.152154 Sep 19 12:40:34.267249 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 517/1024] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:34 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:34.443529 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-6169c647-551c-4644-8930-d032cd1972df tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:34.444236 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6169c647-551c-4644-8930-d032cd1972df tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:34.447160 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=14 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:40:34.451914 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6169c647-551c-4644-8930-d032cd1972df tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:34.452537 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6169c647-551c-4644-8930-d032cd1972df tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:34.452999 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6169c647-551c-4644-8930-d032cd1972df tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:34.453698 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6169c647-551c-4644-8930-d032cd1972df tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:34.454148 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6169c647-551c-4644-8930-d032cd1972df tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:34.454578 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6169c647-551c-4644-8930-d032cd1972df tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:34.490269 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-1b0f8338-a1ac-464f-9cc5-6c53a8a2b0a8 req-353234c1-e500-4d2e-8b70-a29ea71ec8b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0ba5ed-539d-4219-8066-bed154fc37f0", "name": "network-vif-plugged", "status": "completed", "tag": "b8557e4d-5a65-4fe0-94ef-88821e1bd60d"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:40:34.500724 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-1b0f8338-a1ac-464f-9cc5-6c53a8a2b0a8 req-353234c1-e500-4d2e-8b70-a29ea71ec8b4 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:34.501201 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-1b0f8338-a1ac-464f-9cc5-6c53a8a2b0a8 req-353234c1-e500-4d2e-8b70-a29ea71ec8b4 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:34.501625 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-1b0f8338-a1ac-464f-9cc5-6c53a8a2b0a8 req-353234c1-e500-4d2e-8b70-a29ea71ec8b4 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:34.505487 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=100 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:40:34.514212 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-1b0f8338-a1ac-464f-9cc5-6c53a8a2b0a8 req-353234c1-e500-4d2e-8b70-a29ea71ec8b4 service nova] Creating event network-vif-plugged:b8557e4d-5a65-4fe0-94ef-88821e1bd60d for instance 9e0ba5ed-539d-4219-8066-bed154fc37f0 on hv-cinder-85061 Sep 19 12:40:34.519553 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-1b0f8338-a1ac-464f-9cc5-6c53a8a2b0a8 req-353234c1-e500-4d2e-8b70-a29ea71ec8b4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033617 Sep 19 12:40:34.523338 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 518/1025] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:40:34.590615 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-6169c647-551c-4644-8930-d032cd1972df tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:34.598410 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-6169c647-551c-4644-8930-d032cd1972df tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1259 microversion: 2.1 time: 0.159031 Sep 19 12:40:34.598977 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 508/1026] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:34 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:35.290607 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-8b53a753-2874-4ef0-bffb-f0c8c31c22aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:35.291309 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-8b53a753-2874-4ef0-bffb-f0c8c31c22aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:35.297501 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8b53a753-2874-4ef0-bffb-f0c8c31c22aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:35.297986 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8b53a753-2874-4ef0-bffb-f0c8c31c22aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:35.298422 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8b53a753-2874-4ef0-bffb-f0c8c31c22aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:35.299112 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8b53a753-2874-4ef0-bffb-f0c8c31c22aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:35.299565 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8b53a753-2874-4ef0-bffb-f0c8c31c22aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:35.300000 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8b53a753-2874-4ef0-bffb-f0c8c31c22aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:35.430800 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8b53a753-2874-4ef0-bffb-f0c8c31c22aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:35.438490 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-8b53a753-2874-4ef0-bffb-f0c8c31c22aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1266 microversion: 2.1 time: 0.152959 Sep 19 12:40:35.439056 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 519/1027] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:35 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:35.622690 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f18fa926-e9df-4663-a78e-3a8e56e71f00 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:35.623432 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f18fa926-e9df-4663-a78e-3a8e56e71f00 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:35.630185 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f18fa926-e9df-4663-a78e-3a8e56e71f00 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:35.634178 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f18fa926-e9df-4663-a78e-3a8e56e71f00 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:35.634178 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f18fa926-e9df-4663-a78e-3a8e56e71f00 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:35.634178 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f18fa926-e9df-4663-a78e-3a8e56e71f00 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:35.634178 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f18fa926-e9df-4663-a78e-3a8e56e71f00 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:35.634595 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f18fa926-e9df-4663-a78e-3a8e56e71f00 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:35.650372 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:40:35.766783 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f18fa926-e9df-4663-a78e-3a8e56e71f00 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:35.774868 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f18fa926-e9df-4663-a78e-3a8e56e71f00 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1259 microversion: 2.1 time: 0.157038 Sep 19 12:40:35.775425 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 509/1028] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:35 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:36.462199 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-89f1eb37-a2be-49cf-96b9-3c9d0ce246a6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:36.462743 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-89f1eb37-a2be-49cf-96b9-3c9d0ce246a6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:36.469098 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-89f1eb37-a2be-49cf-96b9-3c9d0ce246a6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:36.469575 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-89f1eb37-a2be-49cf-96b9-3c9d0ce246a6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:36.470005 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-89f1eb37-a2be-49cf-96b9-3c9d0ce246a6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:36.470684 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-89f1eb37-a2be-49cf-96b9-3c9d0ce246a6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:36.471129 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-89f1eb37-a2be-49cf-96b9-3c9d0ce246a6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:36.471546 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-89f1eb37-a2be-49cf-96b9-3c9d0ce246a6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:36.601108 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-89f1eb37-a2be-49cf-96b9-3c9d0ce246a6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:36.609643 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-89f1eb37-a2be-49cf-96b9-3c9d0ce246a6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1266 microversion: 2.1 time: 0.151969 Sep 19 12:40:36.610239 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 520/1029] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:36 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:36.798099 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c4d8faa8-1b57-43c7-8c50-2fe258c71ae1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:36.798704 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c4d8faa8-1b57-43c7-8c50-2fe258c71ae1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:36.805612 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c4d8faa8-1b57-43c7-8c50-2fe258c71ae1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:36.806086 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c4d8faa8-1b57-43c7-8c50-2fe258c71ae1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:36.806513 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c4d8faa8-1b57-43c7-8c50-2fe258c71ae1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:36.807189 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c4d8faa8-1b57-43c7-8c50-2fe258c71ae1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:36.807633 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c4d8faa8-1b57-43c7-8c50-2fe258c71ae1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:36.808050 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c4d8faa8-1b57-43c7-8c50-2fe258c71ae1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:36.936155 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c4d8faa8-1b57-43c7-8c50-2fe258c71ae1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:36.943967 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c4d8faa8-1b57-43c7-8c50-2fe258c71ae1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1444 microversion: 2.1 time: 0.149829 Sep 19 12:40:36.944477 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 510/1030] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:36 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1444 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:36.966230 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-92e10ec1-6684-4953-a792-4e4673ff6b05 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:36.966973 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-92e10ec1-6684-4953-a792-4e4673ff6b05 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:36.973203 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-92e10ec1-6684-4953-a792-4e4673ff6b05 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:36.973612 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-92e10ec1-6684-4953-a792-4e4673ff6b05 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:36.974047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-92e10ec1-6684-4953-a792-4e4673ff6b05 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:36.974776 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-92e10ec1-6684-4953-a792-4e4673ff6b05 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:36.975229 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-92e10ec1-6684-4953-a792-4e4673ff6b05 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:36.975725 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-92e10ec1-6684-4953-a792-4e4673ff6b05 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:37.114272 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-92e10ec1-6684-4953-a792-4e4673ff6b05 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:37.126760 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-92e10ec1-6684-4953-a792-4e4673ff6b05 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1444 microversion: 2.1 time: 0.160636 Sep 19 12:40:37.126760 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 521/1031] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:36 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:37.634679 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-0ec917ea-b4f4-496c-81bf-dd7ab3c5c7e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:37.635289 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-0ec917ea-b4f4-496c-81bf-dd7ab3c5c7e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:37.641391 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0ec917ea-b4f4-496c-81bf-dd7ab3c5c7e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:37.641877 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0ec917ea-b4f4-496c-81bf-dd7ab3c5c7e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:37.642305 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0ec917ea-b4f4-496c-81bf-dd7ab3c5c7e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:37.643039 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0ec917ea-b4f4-496c-81bf-dd7ab3c5c7e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:37.643493 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0ec917ea-b4f4-496c-81bf-dd7ab3c5c7e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:37.643913 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0ec917ea-b4f4-496c-81bf-dd7ab3c5c7e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:37.795642 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-0ec917ea-b4f4-496c-81bf-dd7ab3c5c7e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:37.803939 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-0ec917ea-b4f4-496c-81bf-dd7ab3c5c7e6 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1266 microversion: 2.1 time: 0.173687 Sep 19 12:40:37.804556 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 511/1032] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:37 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:38.827964 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-6d310090-8723-48d1-a0d0-f6c14d5c23b3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:38.830511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-6d310090-8723-48d1-a0d0-f6c14d5c23b3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:38.836071 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6d310090-8723-48d1-a0d0-f6c14d5c23b3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:38.836833 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6d310090-8723-48d1-a0d0-f6c14d5c23b3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:38.837462 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6d310090-8723-48d1-a0d0-f6c14d5c23b3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:38.838509 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6d310090-8723-48d1-a0d0-f6c14d5c23b3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:38.839141 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6d310090-8723-48d1-a0d0-f6c14d5c23b3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:38.839571 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-6d310090-8723-48d1-a0d0-f6c14d5c23b3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:39.087182 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-6d310090-8723-48d1-a0d0-f6c14d5c23b3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:39.094792 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-6d310090-8723-48d1-a0d0-f6c14d5c23b3 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1266 microversion: 2.1 time: 0.271299 Sep 19 12:40:39.095367 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 522/1033] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:38 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:39.376183 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-f00f3e96-efb4-4e6a-a1d3-5f1b5aed4666 req-9de278b4-4279-4644-a0b1-8666e6e52429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e0ba5ed-539d-4219-8066-bed154fc37f0", "tag": "b8557e4d-5a65-4fe0-94ef-88821e1bd60d"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:40:39.386281 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-f00f3e96-efb4-4e6a-a1d3-5f1b5aed4666 req-9de278b4-4279-4644-a0b1-8666e6e52429 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:39.386760 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-f00f3e96-efb4-4e6a-a1d3-5f1b5aed4666 req-9de278b4-4279-4644-a0b1-8666e6e52429 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:39.387202 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-f00f3e96-efb4-4e6a-a1d3-5f1b5aed4666 req-9de278b4-4279-4644-a0b1-8666e6e52429 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:39.399563 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-f00f3e96-efb4-4e6a-a1d3-5f1b5aed4666 req-9de278b4-4279-4644-a0b1-8666e6e52429 service nova] Creating event network-changed:b8557e4d-5a65-4fe0-94ef-88821e1bd60d for instance 9e0ba5ed-539d-4219-8066-bed154fc37f0 on hv-cinder-85061 Sep 19 12:40:39.404931 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-f00f3e96-efb4-4e6a-a1d3-5f1b5aed4666 req-9de278b4-4279-4644-a0b1-8666e6e52429 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032680 Sep 19 12:40:39.405579 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 512/1034] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:40:40.117972 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e4dcf000-da53-46a4-87a0-fcb6ff80ab9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:40.118585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-e4dcf000-da53-46a4-87a0-fcb6ff80ab9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:40.125868 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e4dcf000-da53-46a4-87a0-fcb6ff80ab9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:40.126469 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e4dcf000-da53-46a4-87a0-fcb6ff80ab9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:40.126910 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e4dcf000-da53-46a4-87a0-fcb6ff80ab9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:40.127609 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e4dcf000-da53-46a4-87a0-fcb6ff80ab9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:40.128058 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e4dcf000-da53-46a4-87a0-fcb6ff80ab9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:40.128483 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e4dcf000-da53-46a4-87a0-fcb6ff80ab9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:40.271474 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e4dcf000-da53-46a4-87a0-fcb6ff80ab9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:40.280220 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e4dcf000-da53-46a4-87a0-fcb6ff80ab9a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1266 microversion: 2.1 time: 0.166179 Sep 19 12:40:40.281192 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 523/1035] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:40 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:40.682990 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-1b4eba38-566a-4c39-ade5-f441b32a88df req-67c4fe73-561e-479b-bb7a-ac7703b7b731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5c59bf-6037-4a1c-b6be-bd677f066903", "name": "network-vif-plugged", "status": "completed", "tag": "92a0d280-ad6f-4cdd-958b-f758f5800ced"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:40:40.693558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-1b4eba38-566a-4c39-ade5-f441b32a88df req-67c4fe73-561e-479b-bb7a-ac7703b7b731 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:40.694044 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-1b4eba38-566a-4c39-ade5-f441b32a88df req-67c4fe73-561e-479b-bb7a-ac7703b7b731 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:40.694458 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-1b4eba38-566a-4c39-ade5-f441b32a88df req-67c4fe73-561e-479b-bb7a-ac7703b7b731 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:40.707395 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-1b4eba38-566a-4c39-ade5-f441b32a88df req-67c4fe73-561e-479b-bb7a-ac7703b7b731 service nova] Creating event network-vif-plugged:92a0d280-ad6f-4cdd-958b-f758f5800ced for instance 0e5c59bf-6037-4a1c-b6be-bd677f066903 on hv-cinder-85061 Sep 19 12:40:40.712351 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-1b4eba38-566a-4c39-ade5-f441b32a88df req-67c4fe73-561e-479b-bb7a-ac7703b7b731 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034662 Sep 19 12:40:40.712993 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 513/1036] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:40:41.303088 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-047dfbf4-318a-42b5-b062-e8ae5b51a7a0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:41.303729 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-047dfbf4-318a-42b5-b062-e8ae5b51a7a0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:41.310291 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-047dfbf4-318a-42b5-b062-e8ae5b51a7a0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:41.310777 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-047dfbf4-318a-42b5-b062-e8ae5b51a7a0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:41.311213 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-047dfbf4-318a-42b5-b062-e8ae5b51a7a0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:41.311911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-047dfbf4-318a-42b5-b062-e8ae5b51a7a0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:41.312370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-047dfbf4-318a-42b5-b062-e8ae5b51a7a0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:41.312824 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-047dfbf4-318a-42b5-b062-e8ae5b51a7a0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:41.444269 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-047dfbf4-318a-42b5-b062-e8ae5b51a7a0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:41.452402 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-047dfbf4-318a-42b5-b062-e8ae5b51a7a0 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1266 microversion: 2.1 time: 0.153229 Sep 19 12:40:41.453081 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 524/1037] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:41 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:42.477158 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-fd03e947-044a-4b14-98be-5981e23299d5 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:42.477808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-fd03e947-044a-4b14-98be-5981e23299d5 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:42.483986 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fd03e947-044a-4b14-98be-5981e23299d5 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:42.484472 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fd03e947-044a-4b14-98be-5981e23299d5 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:42.484934 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fd03e947-044a-4b14-98be-5981e23299d5 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:42.485629 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fd03e947-044a-4b14-98be-5981e23299d5 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:42.486080 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fd03e947-044a-4b14-98be-5981e23299d5 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:42.486495 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-fd03e947-044a-4b14-98be-5981e23299d5 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:42.618288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-fd03e947-044a-4b14-98be-5981e23299d5 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:42.626318 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-fd03e947-044a-4b14-98be-5981e23299d5 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1266 microversion: 2.1 time: 0.154490 Sep 19 12:40:42.626882 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 514/1038] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:42 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:43.648198 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-f9f91565-816b-4072-826a-a316732da888 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:43.652555 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-f9f91565-816b-4072-826a-a316732da888 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:43.655317 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f9f91565-816b-4072-826a-a316732da888 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:43.655802 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f9f91565-816b-4072-826a-a316732da888 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:43.656237 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f9f91565-816b-4072-826a-a316732da888 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:43.656958 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f9f91565-816b-4072-826a-a316732da888 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:43.657412 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f9f91565-816b-4072-826a-a316732da888 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:43.657839 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-f9f91565-816b-4072-826a-a316732da888 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:43.785508 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-f9f91565-816b-4072-826a-a316732da888 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:43.793656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-f9f91565-816b-4072-826a-a316732da888 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1453 microversion: 2.1 time: 0.149470 Sep 19 12:40:43.794215 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 525/1039] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:43 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:43.815883 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e17eb54e-2891-4b93-995f-ff1a37ae7d02 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:43.816488 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e17eb54e-2891-4b93-995f-ff1a37ae7d02 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:43.822925 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e17eb54e-2891-4b93-995f-ff1a37ae7d02 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:43.823409 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e17eb54e-2891-4b93-995f-ff1a37ae7d02 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:43.823841 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e17eb54e-2891-4b93-995f-ff1a37ae7d02 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:43.824522 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e17eb54e-2891-4b93-995f-ff1a37ae7d02 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:43.825025 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e17eb54e-2891-4b93-995f-ff1a37ae7d02 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:43.825452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e17eb54e-2891-4b93-995f-ff1a37ae7d02 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:43.955217 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e17eb54e-2891-4b93-995f-ff1a37ae7d02 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:43.963057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e17eb54e-2891-4b93-995f-ff1a37ae7d02 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1453 microversion: 2.1 time: 0.150908 Sep 19 12:40:43.963621 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 515/1040] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:43 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:46.179482 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-83f835fd-86aa-4af7-86d8-d0ae240e53e4 req-5492f5a5-e6b9-482e-a171-8a0aec10caa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5c59bf-6037-4a1c-b6be-bd677f066903", "tag": "92a0d280-ad6f-4cdd-958b-f758f5800ced"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:40:46.190409 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-83f835fd-86aa-4af7-86d8-d0ae240e53e4 req-5492f5a5-e6b9-482e-a171-8a0aec10caa7 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:46.190816 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-83f835fd-86aa-4af7-86d8-d0ae240e53e4 req-5492f5a5-e6b9-482e-a171-8a0aec10caa7 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:46.191259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-83f835fd-86aa-4af7-86d8-d0ae240e53e4 req-5492f5a5-e6b9-482e-a171-8a0aec10caa7 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:46.205839 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-83f835fd-86aa-4af7-86d8-d0ae240e53e4 req-5492f5a5-e6b9-482e-a171-8a0aec10caa7 service nova] Creating event network-changed:92a0d280-ad6f-4cdd-958b-f758f5800ced for instance 0e5c59bf-6037-4a1c-b6be-bd677f066903 on hv-cinder-85061 Sep 19 12:40:46.210854 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-83f835fd-86aa-4af7-86d8-d0ae240e53e4 req-5492f5a5-e6b9-482e-a171-8a0aec10caa7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035253 Sep 19 12:40:46.211647 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 526/1041] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:42:25.415553 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:42:25.416326 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=30 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:42:25.417895 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:42:25.418073 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Mon Sep 19 12:42:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.93) !!! Sep 19 12:42:25.422492 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-643f808f-b2c9-4c0e-8580-282c0bed45cb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-792432103", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1129654240", "security_groups": [{"name": "tempest-secgroup-smoke-1134905487"}], "block_device_mapping_v2": [{"uuid": "9d10537b-2fd3-402f-a3cd-1d400ef673b0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e6b353e9-72f5-45ca-9fc7-16de881dafaf"}]}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:42:25.690936 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.network.neutron [None req-643f808f-b2c9-4c0e-8580-282c0bed45cb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] validate_networks() for [('e6b353e9-72f5-45ca-9fc7-16de881dafaf', None, None, None, None, None)] {{(pid=121428) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:42:26.162638 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-643f808f-b2c9-4c0e-8580-282c0bed45cb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Flavor limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:42:26.163056 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-643f808f-b2c9-4c0e-8580-282c0bed45cb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Image limits 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:42:26.163524 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-643f808f-b2c9-4c0e-8580-282c0bed45cb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Flavor pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:42:26.163923 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-643f808f-b2c9-4c0e-8580-282c0bed45cb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Image pref 0:0:0 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:42:26.164322 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.virt.hardware [None req-643f808f-b2c9-4c0e-8580-282c0bed45cb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:42:26.173535 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-643f808f-b2c9-4c0e-8580-282c0bed45cb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:26.174007 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-643f808f-b2c9-4c0e-8580-282c0bed45cb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:26.174431 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-643f808f-b2c9-4c0e-8580-282c0bed45cb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:26.175148 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-643f808f-b2c9-4c0e-8580-282c0bed45cb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:26.175588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-643f808f-b2c9-4c0e-8580-282c0bed45cb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:26.176003 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-643f808f-b2c9-4c0e-8580-282c0bed45cb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:26.192903 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-643f808f-b2c9-4c0e-8580-282c0bed45cb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Getting quotas for project ea2bd5c94eb7415c80a4e24452c08eb4. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:42:26.196884 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.quota [None req-643f808f-b2c9-4c0e-8580-282c0bed45cb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Getting quotas for user 88b8a34360fa4595a07c7d3610563b77 and project ea2bd5c94eb7415c80a4e24452c08eb4. Resources: {'instances', 'ram', 'cores'} {{(pid=121428) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:42:26.253399 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-643f808f-b2c9-4c0e-8580-282c0bed45cb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Going to run 1 instances... {{(pid=121428) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:42:26.255547 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-643f808f-b2c9-4c0e-8580-282c0bed45cb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9d10537b-2fd3-402f-a3cd-1d400ef673b0',volume_size=None,volume_type=None)] {{(pid=121428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:42:26.593614 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-643f808f-b2c9-4c0e-8580-282c0bed45cb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.179978 Sep 19 12:42:26.594645 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 516/1042] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Sep 19 12:42:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:42:26.605531 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0f4a9eac-ab54-4a3b-8e89-ebde97a6db23] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 19 12:42:26.607175 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=64 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:42:26.608068 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=44 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:42:26.609835 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 19 12:42:26.613743 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:42:26.613897 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Mon Sep 19 12:42:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e (ip 10.222.0.93) !!! Sep 19 12:42:26.620415 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-66bee94d-05c6-4025-9a72-8dd154e74508 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:26.628072 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-66bee94d-05c6-4025-9a72-8dd154e74508 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:26.731316 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-66bee94d-05c6-4025-9a72-8dd154e74508 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:26.738450 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-66bee94d-05c6-4025-9a72-8dd154e74508 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1094 microversion: 2.1 time: 0.135670 Sep 19 12:42:26.738944 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 527/1043] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:26 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1094 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:27.761031 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8301f41c-2afd-4e5f-a685-87e14969ea3e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:27.761672 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-8301f41c-2afd-4e5f-a685-87e14969ea3e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:27.818640 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-8301f41c-2afd-4e5f-a685-87e14969ea3e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:27.822187 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8301f41c-2afd-4e5f-a685-87e14969ea3e tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1094 microversion: 2.1 time: 0.065610 Sep 19 12:42:27.822751 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 517/1044] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:27 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:28.845489 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-0f1e52de-98ed-4478-bdb0-f550c6899d66 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:28.846089 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-0f1e52de-98ed-4478-bdb0-f550c6899d66 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:28.859190 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO oslo.messaging._drivers.impl_rabbit [-] [0f4a9eac-ab54-4a3b-8e89-ebde97a6db23] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 49886. Sep 19 12:42:28.903667 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-0f1e52de-98ed-4478-bdb0-f550c6899d66 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:28.910651 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-0f1e52de-98ed-4478-bdb0-f550c6899d66 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1094 microversion: 2.1 time: 0.069030 Sep 19 12:42:28.914940 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 528/1045] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:28 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:29.934469 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-8a7e9d57-e7de-4db9-bd7e-6708590a382b tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:29.935072 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-8a7e9d57-e7de-4db9-bd7e-6708590a382b tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:29.991431 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-8a7e9d57-e7de-4db9-bd7e-6708590a382b tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:29.999190 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-8a7e9d57-e7de-4db9-bd7e-6708590a382b tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1094 microversion: 2.1 time: 0.069210 Sep 19 12:42:29.999768 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 518/1046] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:29 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:31.022992 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4ec7f024-2ceb-442b-aead-090622052483 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:31.023579 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4ec7f024-2ceb-442b-aead-090622052483 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:31.030298 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4ec7f024-2ceb-442b-aead-090622052483 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:31.030773 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4ec7f024-2ceb-442b-aead-090622052483 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:31.031204 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4ec7f024-2ceb-442b-aead-090622052483 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:31.031908 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4ec7f024-2ceb-442b-aead-090622052483 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:31.032344 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4ec7f024-2ceb-442b-aead-090622052483 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:31.032797 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4ec7f024-2ceb-442b-aead-090622052483 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:31.098448 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-4ec7f024-2ceb-442b-aead-090622052483 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:31.106086 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4ec7f024-2ceb-442b-aead-090622052483 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1144 microversion: 2.1 time: 0.087178 Sep 19 12:42:31.107161 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 529/1047] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:31 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:32.129520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d7f6d087-2120-44b0-931b-c1f363a9c217 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:32.130160 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d7f6d087-2120-44b0-931b-c1f363a9c217 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:32.137228 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d7f6d087-2120-44b0-931b-c1f363a9c217 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:32.137757 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d7f6d087-2120-44b0-931b-c1f363a9c217 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:32.138188 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d7f6d087-2120-44b0-931b-c1f363a9c217 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:32.139045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d7f6d087-2120-44b0-931b-c1f363a9c217 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:32.139494 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d7f6d087-2120-44b0-931b-c1f363a9c217 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:32.139916 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d7f6d087-2120-44b0-931b-c1f363a9c217 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:32.209008 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-d7f6d087-2120-44b0-931b-c1f363a9c217 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:32.217585 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d7f6d087-2120-44b0-931b-c1f363a9c217 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1192 microversion: 2.1 time: 0.091959 Sep 19 12:42:32.218166 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 519/1048] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:32 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:33.242103 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b6b12c45-45c9-4a45-8a58-4f40614c598d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:33.242686 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b6b12c45-45c9-4a45-8a58-4f40614c598d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:33.250504 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b6b12c45-45c9-4a45-8a58-4f40614c598d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:33.251000 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b6b12c45-45c9-4a45-8a58-4f40614c598d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:33.251434 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b6b12c45-45c9-4a45-8a58-4f40614c598d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:33.252151 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b6b12c45-45c9-4a45-8a58-4f40614c598d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:33.252638 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b6b12c45-45c9-4a45-8a58-4f40614c598d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:33.253078 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b6b12c45-45c9-4a45-8a58-4f40614c598d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:33.330465 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-b6b12c45-45c9-4a45-8a58-4f40614c598d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:33.338711 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-b6b12c45-45c9-4a45-8a58-4f40614c598d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1210 microversion: 2.1 time: 0.100575 Sep 19 12:42:33.339305 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 530/1049] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:33 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:34.361851 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-1ca036e2-ee26-4000-b8ca-5226077fd166 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:34.363202 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-1ca036e2-ee26-4000-b8ca-5226077fd166 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:34.370183 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1ca036e2-ee26-4000-b8ca-5226077fd166 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:34.370591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1ca036e2-ee26-4000-b8ca-5226077fd166 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:34.371106 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1ca036e2-ee26-4000-b8ca-5226077fd166 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:34.371835 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1ca036e2-ee26-4000-b8ca-5226077fd166 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:34.372527 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1ca036e2-ee26-4000-b8ca-5226077fd166 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:34.373111 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1ca036e2-ee26-4000-b8ca-5226077fd166 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:34.527996 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-1ca036e2-ee26-4000-b8ca-5226077fd166 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:34.536261 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-1ca036e2-ee26-4000-b8ca-5226077fd166 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1278 microversion: 2.1 time: 0.178299 Sep 19 12:42:34.536866 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 520/1050] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:34 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:35.019504 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-8ee010e1-fccb-4ea9-a653-3a6116496dcc req-e7c842f2-03d5-4e90-9368-5a3348a7f5ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911e4970-9926-4489-bbba-294c19734f5e", "tag": "8f965105-2928-43e8-bcc0-3ed7aef6d87f"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:42:35.029533 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-8ee010e1-fccb-4ea9-a653-3a6116496dcc req-e7c842f2-03d5-4e90-9368-5a3348a7f5ff service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:35.030017 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-8ee010e1-fccb-4ea9-a653-3a6116496dcc req-e7c842f2-03d5-4e90-9368-5a3348a7f5ff service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:35.030469 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-8ee010e1-fccb-4ea9-a653-3a6116496dcc req-e7c842f2-03d5-4e90-9368-5a3348a7f5ff service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:35.042350 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-8ee010e1-fccb-4ea9-a653-3a6116496dcc req-e7c842f2-03d5-4e90-9368-5a3348a7f5ff service nova] Creating event network-changed:8f965105-2928-43e8-bcc0-3ed7aef6d87f for instance 911e4970-9926-4489-bbba-294c19734f5e on hv-cinder-85061 Sep 19 12:42:35.048053 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-8ee010e1-fccb-4ea9-a653-3a6116496dcc req-e7c842f2-03d5-4e90-9368-5a3348a7f5ff service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032202 Sep 19 12:42:35.048985 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 531/1051] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:42:35.559710 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-256b94dc-17b4-4066-828b-5302af41b193 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:35.560444 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-256b94dc-17b4-4066-828b-5302af41b193 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:35.566672 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-256b94dc-17b4-4066-828b-5302af41b193 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:35.571494 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-256b94dc-17b4-4066-828b-5302af41b193 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:35.571494 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-256b94dc-17b4-4066-828b-5302af41b193 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:35.571494 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-256b94dc-17b4-4066-828b-5302af41b193 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:35.571494 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-256b94dc-17b4-4066-828b-5302af41b193 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:35.571945 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-256b94dc-17b4-4066-828b-5302af41b193 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:35.802276 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-256b94dc-17b4-4066-828b-5302af41b193 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:35.810650 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-256b94dc-17b4-4066-828b-5302af41b193 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1266 microversion: 2.1 time: 0.254960 Sep 19 12:42:35.811288 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 521/1052] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:35 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:36.839214 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-a198d298-3f4d-4b80-b2e0-b83f150606ec tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:36.840021 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-a198d298-3f4d-4b80-b2e0-b83f150606ec tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:36.847187 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a198d298-3f4d-4b80-b2e0-b83f150606ec tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:36.847681 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a198d298-3f4d-4b80-b2e0-b83f150606ec tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:36.848115 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a198d298-3f4d-4b80-b2e0-b83f150606ec tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:36.848864 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a198d298-3f4d-4b80-b2e0-b83f150606ec tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:36.849310 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a198d298-3f4d-4b80-b2e0-b83f150606ec tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:36.849739 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a198d298-3f4d-4b80-b2e0-b83f150606ec tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:36.993331 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-a198d298-3f4d-4b80-b2e0-b83f150606ec tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:37.002102 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-a198d298-3f4d-4b80-b2e0-b83f150606ec tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1266 microversion: 2.1 time: 0.169961 Sep 19 12:42:37.002713 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 532/1053] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:36 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:37.575859 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a9072892-27fe-4992-9305-95bb7d53d7b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:42:37.576485 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a9072892-27fe-4992-9305-95bb7d53d7b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:37.578425 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=2 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:42:37.583171 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9072892-27fe-4992-9305-95bb7d53d7b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:37.583647 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9072892-27fe-4992-9305-95bb7d53d7b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:37.584080 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9072892-27fe-4992-9305-95bb7d53d7b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:37.584796 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9072892-27fe-4992-9305-95bb7d53d7b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:37.585246 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9072892-27fe-4992-9305-95bb7d53d7b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:37.585669 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a9072892-27fe-4992-9305-95bb7d53d7b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:37.609205 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-a9072892-27fe-4992-9305-95bb7d53d7b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lazy-loading 'flavor' on Instance uuid 9e0ba5ed-539d-4219-8066-bed154fc37f0 {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:42:37.898898 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a9072892-27fe-4992-9305-95bb7d53d7b4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "POST /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0/action" status: 202 len: 0 microversion: 2.1 time: 0.326654 Sep 19 12:42:37.899478 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 522/1054] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Sep 19 12:42:37 2022] POST /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:42:37.908581 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-11a088cd-6ffd-4ace-b602-bb8eaf608727 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:37.913363 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-11a088cd-6ffd-4ace-b602-bb8eaf608727 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:37.916106 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-11a088cd-6ffd-4ace-b602-bb8eaf608727 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:37.916969 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-11a088cd-6ffd-4ace-b602-bb8eaf608727 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:37.917076 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-11a088cd-6ffd-4ace-b602-bb8eaf608727 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:37.917708 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-11a088cd-6ffd-4ace-b602-bb8eaf608727 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:37.918173 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-11a088cd-6ffd-4ace-b602-bb8eaf608727 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:37.918573 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-11a088cd-6ffd-4ace-b602-bb8eaf608727 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:38.025523 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-0af8acfa-eba7-4d72-ac84-1610997dcc36 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:38.026341 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-0af8acfa-eba7-4d72-ac84-1610997dcc36 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:38.033065 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0af8acfa-eba7-4d72-ac84-1610997dcc36 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:38.033598 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0af8acfa-eba7-4d72-ac84-1610997dcc36 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:38.034117 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0af8acfa-eba7-4d72-ac84-1610997dcc36 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:38.034722 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0af8acfa-eba7-4d72-ac84-1610997dcc36 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:38.035166 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0af8acfa-eba7-4d72-ac84-1610997dcc36 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:38.035580 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-0af8acfa-eba7-4d72-ac84-1610997dcc36 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:38.057531 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-11a088cd-6ffd-4ace-b602-bb8eaf608727 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:38.065384 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-11a088cd-6ffd-4ace-b602-bb8eaf608727 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1569 microversion: 2.1 time: 0.161326 Sep 19 12:42:38.065964 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 533/1055] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:37 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:38.167128 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-0af8acfa-eba7-4d72-ac84-1610997dcc36 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:38.175235 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-0af8acfa-eba7-4d72-ac84-1610997dcc36 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1266 microversion: 2.1 time: 0.153964 Sep 19 12:42:38.183026 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 523/1056] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:38 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:42:39.089495 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-8d4639b4-4a92-4e3e-9a62-c5ed5e8fa131 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:39.090106 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-8d4639b4-4a92-4e3e-9a62-c5ed5e8fa131 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:39.092754 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell0:SELECT=4 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:42:39.098020 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8d4639b4-4a92-4e3e-9a62-c5ed5e8fa131 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:39.098496 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8d4639b4-4a92-4e3e-9a62-c5ed5e8fa131 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:39.098928 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8d4639b4-4a92-4e3e-9a62-c5ed5e8fa131 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:39.099612 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8d4639b4-4a92-4e3e-9a62-c5ed5e8fa131 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:39.100059 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8d4639b4-4a92-4e3e-9a62-c5ed5e8fa131 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:39.100477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-8d4639b4-4a92-4e3e-9a62-c5ed5e8fa131 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:39.198555 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-50de7f42-faa4-4a04-b1d1-70c6900cc94d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:39.199156 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-50de7f42-faa4-4a04-b1d1-70c6900cc94d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:39.205538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-50de7f42-faa4-4a04-b1d1-70c6900cc94d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:39.206022 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-50de7f42-faa4-4a04-b1d1-70c6900cc94d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:39.206973 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-50de7f42-faa4-4a04-b1d1-70c6900cc94d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:39.207157 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-50de7f42-faa4-4a04-b1d1-70c6900cc94d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:39.207676 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-50de7f42-faa4-4a04-b1d1-70c6900cc94d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:39.208026 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-50de7f42-faa4-4a04-b1d1-70c6900cc94d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:39.239046 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-8d4639b4-4a92-4e3e-9a62-c5ed5e8fa131 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:39.247021 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-8d4639b4-4a92-4e3e-9a62-c5ed5e8fa131 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1569 microversion: 2.1 time: 0.161382 Sep 19 12:42:39.247940 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 534/1057] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:39 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:39.337761 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-50de7f42-faa4-4a04-b1d1-70c6900cc94d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:39.346148 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-50de7f42-faa4-4a04-b1d1-70c6900cc94d tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1266 microversion: 2.1 time: 0.151400 Sep 19 12:42:39.346659 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 524/1058] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:39 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:42:40.271042 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9e6e91d7-99d5-44b6-994f-6f14fb49d319 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:40.271658 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9e6e91d7-99d5-44b6-994f-6f14fb49d319 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:40.278096 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9e6e91d7-99d5-44b6-994f-6f14fb49d319 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:40.278586 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9e6e91d7-99d5-44b6-994f-6f14fb49d319 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:40.279027 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9e6e91d7-99d5-44b6-994f-6f14fb49d319 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:40.279739 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9e6e91d7-99d5-44b6-994f-6f14fb49d319 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:40.280990 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9e6e91d7-99d5-44b6-994f-6f14fb49d319 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:40.281434 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9e6e91d7-99d5-44b6-994f-6f14fb49d319 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:40.369363 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-23c5f44c-3f85-46eb-92e8-0ebcc5e1297f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:40.370073 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-23c5f44c-3f85-46eb-92e8-0ebcc5e1297f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:40.372146 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell0:SELECT=10 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:42:40.378469 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-23c5f44c-3f85-46eb-92e8-0ebcc5e1297f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:40.379036 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-23c5f44c-3f85-46eb-92e8-0ebcc5e1297f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:40.379540 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-23c5f44c-3f85-46eb-92e8-0ebcc5e1297f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:40.380308 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-23c5f44c-3f85-46eb-92e8-0ebcc5e1297f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:40.380866 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-23c5f44c-3f85-46eb-92e8-0ebcc5e1297f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:40.381358 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-23c5f44c-3f85-46eb-92e8-0ebcc5e1297f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:40.417094 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9e6e91d7-99d5-44b6-994f-6f14fb49d319 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:40.425694 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9e6e91d7-99d5-44b6-994f-6f14fb49d319 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1569 microversion: 2.1 time: 0.158556 Sep 19 12:42:40.426276 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 535/1059] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:40 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:40.514874 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-23c5f44c-3f85-46eb-92e8-0ebcc5e1297f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:40.522764 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-23c5f44c-3f85-46eb-92e8-0ebcc5e1297f tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1266 microversion: 2.1 time: 0.157572 Sep 19 12:42:40.523558 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 525/1060] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:40 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:41.449888 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-c25ba240-d91d-42fe-acb1-ff9bec2996ea tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:41.450480 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-c25ba240-d91d-42fe-acb1-ff9bec2996ea tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:41.457756 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c25ba240-d91d-42fe-acb1-ff9bec2996ea tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:41.458239 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c25ba240-d91d-42fe-acb1-ff9bec2996ea tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:41.458736 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c25ba240-d91d-42fe-acb1-ff9bec2996ea tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:41.459423 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c25ba240-d91d-42fe-acb1-ff9bec2996ea tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:41.459883 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c25ba240-d91d-42fe-acb1-ff9bec2996ea tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:41.460385 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-c25ba240-d91d-42fe-acb1-ff9bec2996ea tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:41.547130 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b2fb99c7-63ce-4ac1-b1b1-bb5d10fa0c44 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:41.547772 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-b2fb99c7-63ce-4ac1-b1b1-bb5d10fa0c44 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:41.554534 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b2fb99c7-63ce-4ac1-b1b1-bb5d10fa0c44 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:41.555090 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b2fb99c7-63ce-4ac1-b1b1-bb5d10fa0c44 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:41.555537 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b2fb99c7-63ce-4ac1-b1b1-bb5d10fa0c44 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:41.556243 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b2fb99c7-63ce-4ac1-b1b1-bb5d10fa0c44 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:41.556885 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b2fb99c7-63ce-4ac1-b1b1-bb5d10fa0c44 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:41.557307 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b2fb99c7-63ce-4ac1-b1b1-bb5d10fa0c44 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:41.595003 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-c25ba240-d91d-42fe-acb1-ff9bec2996ea tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:41.603313 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-c25ba240-d91d-42fe-acb1-ff9bec2996ea tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1569 microversion: 2.1 time: 0.157674 Sep 19 12:42:41.604056 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 536/1061] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:41 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:41.699479 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-b2fb99c7-63ce-4ac1-b1b1-bb5d10fa0c44 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:41.706050 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-b2fb99c7-63ce-4ac1-b1b1-bb5d10fa0c44 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1266 microversion: 2.1 time: 0.163296 Sep 19 12:42:41.706551 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 526/1062] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:41 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:42.628248 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-7f4b4c1e-4bb3-4eb0-8739-b8b548226c53 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:42.628879 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-7f4b4c1e-4bb3-4eb0-8739-b8b548226c53 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:42.635251 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7f4b4c1e-4bb3-4eb0-8739-b8b548226c53 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:42.635726 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7f4b4c1e-4bb3-4eb0-8739-b8b548226c53 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:42.636157 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7f4b4c1e-4bb3-4eb0-8739-b8b548226c53 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:42.636872 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7f4b4c1e-4bb3-4eb0-8739-b8b548226c53 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:42.637323 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7f4b4c1e-4bb3-4eb0-8739-b8b548226c53 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:42.637741 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7f4b4c1e-4bb3-4eb0-8739-b8b548226c53 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:42.729185 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-a63c4752-c7b4-4f14-9eff-f8bd392f6baa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:42.729808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-a63c4752-c7b4-4f14-9eff-f8bd392f6baa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:42.736457 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a63c4752-c7b4-4f14-9eff-f8bd392f6baa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:42.739542 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a63c4752-c7b4-4f14-9eff-f8bd392f6baa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:42.739542 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a63c4752-c7b4-4f14-9eff-f8bd392f6baa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:42.739542 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a63c4752-c7b4-4f14-9eff-f8bd392f6baa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:42.739542 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a63c4752-c7b4-4f14-9eff-f8bd392f6baa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:42.740016 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-a63c4752-c7b4-4f14-9eff-f8bd392f6baa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:42.767974 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-7f4b4c1e-4bb3-4eb0-8739-b8b548226c53 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:42.776065 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-7f4b4c1e-4bb3-4eb0-8739-b8b548226c53 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1569 microversion: 2.1 time: 0.152144 Sep 19 12:42:42.776664 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 537/1063] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:42 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:42.872770 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-a63c4752-c7b4-4f14-9eff-f8bd392f6baa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:42.880936 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-a63c4752-c7b4-4f14-9eff-f8bd392f6baa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1266 microversion: 2.1 time: 0.155606 Sep 19 12:42:42.881434 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 527/1064] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:42 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:43.799347 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-157fa901-a539-4a89-a419-bb74b673ed42 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:43.799901 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-157fa901-a539-4a89-a419-bb74b673ed42 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:43.806336 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-157fa901-a539-4a89-a419-bb74b673ed42 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:43.806817 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-157fa901-a539-4a89-a419-bb74b673ed42 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:43.807252 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-157fa901-a539-4a89-a419-bb74b673ed42 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:43.807961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-157fa901-a539-4a89-a419-bb74b673ed42 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:43.808405 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-157fa901-a539-4a89-a419-bb74b673ed42 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:43.808850 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-157fa901-a539-4a89-a419-bb74b673ed42 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:43.905531 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-5ac31f8e-fe76-4632-9daa-da14481b8eb4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:43.906793 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-5ac31f8e-fe76-4632-9daa-da14481b8eb4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:43.913219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5ac31f8e-fe76-4632-9daa-da14481b8eb4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:43.913702 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5ac31f8e-fe76-4632-9daa-da14481b8eb4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:43.914130 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5ac31f8e-fe76-4632-9daa-da14481b8eb4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:43.914821 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5ac31f8e-fe76-4632-9daa-da14481b8eb4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:43.915269 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5ac31f8e-fe76-4632-9daa-da14481b8eb4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:43.915687 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5ac31f8e-fe76-4632-9daa-da14481b8eb4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:43.936648 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-157fa901-a539-4a89-a419-bb74b673ed42 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:43.944390 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-157fa901-a539-4a89-a419-bb74b673ed42 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1569 microversion: 2.1 time: 0.149061 Sep 19 12:42:43.945319 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 538/1065] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:43 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:44.047678 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5ac31f8e-fe76-4632-9daa-da14481b8eb4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:44.055330 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-5ac31f8e-fe76-4632-9daa-da14481b8eb4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1266 microversion: 2.1 time: 0.153531 Sep 19 12:42:44.055829 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 528/1066] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:43 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:42:44.967365 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e4f65199-a978-4bbb-a9f8-ffd43484e062 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:44.967977 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-e4f65199-a978-4bbb-a9f8-ffd43484e062 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:44.974953 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e4f65199-a978-4bbb-a9f8-ffd43484e062 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:44.975429 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e4f65199-a978-4bbb-a9f8-ffd43484e062 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:44.975861 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e4f65199-a978-4bbb-a9f8-ffd43484e062 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:44.976553 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e4f65199-a978-4bbb-a9f8-ffd43484e062 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:44.977041 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e4f65199-a978-4bbb-a9f8-ffd43484e062 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:44.977463 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e4f65199-a978-4bbb-a9f8-ffd43484e062 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:45.086629 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-3c1a6b52-f6a6-4840-ba27-819c22c99499 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:45.086629 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-3c1a6b52-f6a6-4840-ba27-819c22c99499 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:45.086629 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3c1a6b52-f6a6-4840-ba27-819c22c99499 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:45.086629 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3c1a6b52-f6a6-4840-ba27-819c22c99499 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:45.087397 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3c1a6b52-f6a6-4840-ba27-819c22c99499 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:45.087397 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3c1a6b52-f6a6-4840-ba27-819c22c99499 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:45.087397 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3c1a6b52-f6a6-4840-ba27-819c22c99499 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:45.087397 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3c1a6b52-f6a6-4840-ba27-819c22c99499 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:45.114586 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e4f65199-a978-4bbb-a9f8-ffd43484e062 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:45.124249 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e4f65199-a978-4bbb-a9f8-ffd43484e062 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1569 microversion: 2.1 time: 0.160756 Sep 19 12:42:45.124855 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 539/1067] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:44 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:45.224454 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-3c1a6b52-f6a6-4840-ba27-819c22c99499 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:45.232135 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-3c1a6b52-f6a6-4840-ba27-819c22c99499 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1266 microversion: 2.1 time: 0.159114 Sep 19 12:42:45.232937 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 529/1068] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:45 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:42:45.253066 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-9ccc5ddb-9310-4c3e-be47-fdf81f8ad089 req-40fef58f-febf-4d9b-bab6-ba2d015ffadc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911e4970-9926-4489-bbba-294c19734f5e", "name": "network-vif-plugged", "status": "completed", "tag": "8f965105-2928-43e8-bcc0-3ed7aef6d87f"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:42:45.262486 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-9ccc5ddb-9310-4c3e-be47-fdf81f8ad089 req-40fef58f-febf-4d9b-bab6-ba2d015ffadc service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:45.262961 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-9ccc5ddb-9310-4c3e-be47-fdf81f8ad089 req-40fef58f-febf-4d9b-bab6-ba2d015ffadc service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:45.263379 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-9ccc5ddb-9310-4c3e-be47-fdf81f8ad089 req-40fef58f-febf-4d9b-bab6-ba2d015ffadc service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:45.274612 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-9ccc5ddb-9310-4c3e-be47-fdf81f8ad089 req-40fef58f-febf-4d9b-bab6-ba2d015ffadc service nova] Creating event network-vif-plugged:8f965105-2928-43e8-bcc0-3ed7aef6d87f for instance 911e4970-9926-4489-bbba-294c19734f5e on hv-cinder-85061 Sep 19 12:42:45.280003 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-9ccc5ddb-9310-4c3e-be47-fdf81f8ad089 req-40fef58f-febf-4d9b-bab6-ba2d015ffadc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030702 Sep 19 12:42:45.280631 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 540/1069] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:42:46.148791 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-5b8082f5-f925-4bd5-8499-ca7c9a1adbed tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:46.149401 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-5b8082f5-f925-4bd5-8499-ca7c9a1adbed tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:46.156095 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5b8082f5-f925-4bd5-8499-ca7c9a1adbed tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:46.156441 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5b8082f5-f925-4bd5-8499-ca7c9a1adbed tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:46.156902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5b8082f5-f925-4bd5-8499-ca7c9a1adbed tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:46.157594 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5b8082f5-f925-4bd5-8499-ca7c9a1adbed tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:46.158042 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5b8082f5-f925-4bd5-8499-ca7c9a1adbed tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:46.158494 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5b8082f5-f925-4bd5-8499-ca7c9a1adbed tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:46.256841 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-7f5b89e8-b887-4ee7-9192-d424b7c5b088 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:46.257543 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-7f5b89e8-b887-4ee7-9192-d424b7c5b088 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:46.263608 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7f5b89e8-b887-4ee7-9192-d424b7c5b088 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:46.264152 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7f5b89e8-b887-4ee7-9192-d424b7c5b088 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:46.264590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7f5b89e8-b887-4ee7-9192-d424b7c5b088 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:46.265316 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7f5b89e8-b887-4ee7-9192-d424b7c5b088 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:46.265767 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7f5b89e8-b887-4ee7-9192-d424b7c5b088 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:46.266188 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-7f5b89e8-b887-4ee7-9192-d424b7c5b088 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:46.289201 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5b8082f5-f925-4bd5-8499-ca7c9a1adbed tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:46.297431 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-5b8082f5-f925-4bd5-8499-ca7c9a1adbed tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1569 microversion: 2.1 time: 0.152099 Sep 19 12:42:46.298010 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 530/1070] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:46 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:46.398581 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-7f5b89e8-b887-4ee7-9192-d424b7c5b088 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:46.406826 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-7f5b89e8-b887-4ee7-9192-d424b7c5b088 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1266 microversion: 2.1 time: 0.154118 Sep 19 12:42:46.407328 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 541/1071] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:46 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:42:47.321252 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-9e7fb366-5372-4475-8d82-a75cc3d3f1b1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:47.322037 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-9e7fb366-5372-4475-8d82-a75cc3d3f1b1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:47.329145 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9e7fb366-5372-4475-8d82-a75cc3d3f1b1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:47.329705 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9e7fb366-5372-4475-8d82-a75cc3d3f1b1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:47.330208 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9e7fb366-5372-4475-8d82-a75cc3d3f1b1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:47.330970 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9e7fb366-5372-4475-8d82-a75cc3d3f1b1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:47.331489 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9e7fb366-5372-4475-8d82-a75cc3d3f1b1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:47.331999 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-9e7fb366-5372-4475-8d82-a75cc3d3f1b1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:47.429880 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-b5393a47-37eb-454a-a13e-7a80c8e25688 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:47.432089 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-b5393a47-37eb-454a-a13e-7a80c8e25688 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:47.436979 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b5393a47-37eb-454a-a13e-7a80c8e25688 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:47.437967 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b5393a47-37eb-454a-a13e-7a80c8e25688 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:47.438403 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b5393a47-37eb-454a-a13e-7a80c8e25688 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:47.439109 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b5393a47-37eb-454a-a13e-7a80c8e25688 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:47.439555 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b5393a47-37eb-454a-a13e-7a80c8e25688 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:47.439993 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-b5393a47-37eb-454a-a13e-7a80c8e25688 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:47.467150 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-9e7fb366-5372-4475-8d82-a75cc3d3f1b1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:47.475559 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-9e7fb366-5372-4475-8d82-a75cc3d3f1b1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1569 microversion: 2.1 time: 0.158505 Sep 19 12:42:47.476136 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 531/1072] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:47 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:42:47.579565 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-b5393a47-37eb-454a-a13e-7a80c8e25688 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:47.587467 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-b5393a47-37eb-454a-a13e-7a80c8e25688 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1266 microversion: 2.1 time: 0.161451 Sep 19 12:42:47.590515 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 542/1073] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:47 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:42:48.499992 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-5102ed4f-9f7b-43dd-b9c9-95e3485e0d73 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:48.500566 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-5102ed4f-9f7b-43dd-b9c9-95e3485e0d73 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:48.507715 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5102ed4f-9f7b-43dd-b9c9-95e3485e0d73 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:48.508209 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5102ed4f-9f7b-43dd-b9c9-95e3485e0d73 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:48.508663 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5102ed4f-9f7b-43dd-b9c9-95e3485e0d73 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:48.509365 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5102ed4f-9f7b-43dd-b9c9-95e3485e0d73 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:48.509819 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5102ed4f-9f7b-43dd-b9c9-95e3485e0d73 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:48.510241 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-5102ed4f-9f7b-43dd-b9c9-95e3485e0d73 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:48.611626 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-a42495fa-c847-4a72-aec7-941b5cc35bf1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:48.612246 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-a42495fa-c847-4a72-aec7-941b5cc35bf1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:48.618875 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a42495fa-c847-4a72-aec7-941b5cc35bf1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:48.619367 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a42495fa-c847-4a72-aec7-941b5cc35bf1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:48.619810 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a42495fa-c847-4a72-aec7-941b5cc35bf1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:48.620517 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a42495fa-c847-4a72-aec7-941b5cc35bf1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:48.621005 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a42495fa-c847-4a72-aec7-941b5cc35bf1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:48.621436 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-a42495fa-c847-4a72-aec7-941b5cc35bf1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:48.912153 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-a42495fa-c847-4a72-aec7-941b5cc35bf1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:48.920115 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-a42495fa-c847-4a72-aec7-941b5cc35bf1 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1454 microversion: 2.1 time: 0.312424 Sep 19 12:42:48.920552 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-5102ed4f-9f7b-43dd-b9c9-95e3485e0d73 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:48.927137 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 543/1074] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:48 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1454 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:42:48.929817 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-5102ed4f-9f7b-43dd-b9c9-95e3485e0d73 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1569 microversion: 2.1 time: 0.434016 Sep 19 12:42:48.941992 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 532/1075] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:48 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1569 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:48.943268 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2526b0f6-c0ef-460e-a821-42354e15e50a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:48.943891 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2526b0f6-c0ef-460e-a821-42354e15e50a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:48.950057 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2526b0f6-c0ef-460e-a821-42354e15e50a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:48.950550 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2526b0f6-c0ef-460e-a821-42354e15e50a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:48.950993 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2526b0f6-c0ef-460e-a821-42354e15e50a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:48.951705 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2526b0f6-c0ef-460e-a821-42354e15e50a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:48.952163 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2526b0f6-c0ef-460e-a821-42354e15e50a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:48.952665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2526b0f6-c0ef-460e-a821-42354e15e50a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:49.162429 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2526b0f6-c0ef-460e-a821-42354e15e50a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:49.170417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2526b0f6-c0ef-460e-a821-42354e15e50a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1454 microversion: 2.1 time: 0.231057 Sep 19 12:42:49.170996 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 544/1076] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:48 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1454 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:49.959274 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-1c68f30c-34bd-4277-95fe-f3b572f3970e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:49.959822 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-1c68f30c-34bd-4277-95fe-f3b572f3970e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:49.966530 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1c68f30c-34bd-4277-95fe-f3b572f3970e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:49.967015 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1c68f30c-34bd-4277-95fe-f3b572f3970e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:49.967571 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1c68f30c-34bd-4277-95fe-f3b572f3970e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:49.968902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1c68f30c-34bd-4277-95fe-f3b572f3970e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:49.969365 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1c68f30c-34bd-4277-95fe-f3b572f3970e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:49.969787 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1c68f30c-34bd-4277-95fe-f3b572f3970e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:49.973937 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:42:50.104138 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-1c68f30c-34bd-4277-95fe-f3b572f3970e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:50.112050 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-1c68f30c-34bd-4277-95fe-f3b572f3970e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1569 microversion: 2.1 time: 0.156721 Sep 19 12:42:50.115057 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 533/1077] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:49 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:51.135463 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-1248c87e-6a26-4113-8426-e36381a04bd6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:51.136157 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-1248c87e-6a26-4113-8426-e36381a04bd6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:51.143339 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1248c87e-6a26-4113-8426-e36381a04bd6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:51.143821 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1248c87e-6a26-4113-8426-e36381a04bd6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:51.144461 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1248c87e-6a26-4113-8426-e36381a04bd6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:51.145181 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1248c87e-6a26-4113-8426-e36381a04bd6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:51.145871 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1248c87e-6a26-4113-8426-e36381a04bd6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:51.146520 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-1248c87e-6a26-4113-8426-e36381a04bd6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:51.212380 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-7e4f9f3f-9125-480d-9f80-08413582377f req-b1c26660-0401-4f86-9d0e-681213cfda9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911e4970-9926-4489-bbba-294c19734f5e", "tag": "8f965105-2928-43e8-bcc0-3ed7aef6d87f"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:42:51.222679 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-7e4f9f3f-9125-480d-9f80-08413582377f req-b1c26660-0401-4f86-9d0e-681213cfda9c service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:51.223179 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-7e4f9f3f-9125-480d-9f80-08413582377f req-b1c26660-0401-4f86-9d0e-681213cfda9c service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:51.223794 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-7e4f9f3f-9125-480d-9f80-08413582377f req-b1c26660-0401-4f86-9d0e-681213cfda9c service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:51.236725 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-7e4f9f3f-9125-480d-9f80-08413582377f req-b1c26660-0401-4f86-9d0e-681213cfda9c service nova] Creating event network-changed:8f965105-2928-43e8-bcc0-3ed7aef6d87f for instance 911e4970-9926-4489-bbba-294c19734f5e on hv-cinder-85061 Sep 19 12:42:51.245990 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-7e4f9f3f-9125-480d-9f80-08413582377f req-b1c26660-0401-4f86-9d0e-681213cfda9c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165981 Sep 19 12:42:51.246602 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 545/1078] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:42:51.338233 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-1248c87e-6a26-4113-8426-e36381a04bd6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:51.349272 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-1248c87e-6a26-4113-8426-e36381a04bd6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1569 microversion: 2.1 time: 0.217731 Sep 19 12:42:51.359983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 534/1079] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:51 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:42:52.377184 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-980924d5-264e-4bcd-a053-5f86d352f5d4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:52.377890 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-980924d5-264e-4bcd-a053-5f86d352f5d4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:52.384002 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-980924d5-264e-4bcd-a053-5f86d352f5d4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:52.384484 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-980924d5-264e-4bcd-a053-5f86d352f5d4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:52.384955 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-980924d5-264e-4bcd-a053-5f86d352f5d4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:52.385648 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-980924d5-264e-4bcd-a053-5f86d352f5d4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:52.386103 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-980924d5-264e-4bcd-a053-5f86d352f5d4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:52.386524 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-980924d5-264e-4bcd-a053-5f86d352f5d4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:52.519047 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-980924d5-264e-4bcd-a053-5f86d352f5d4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:52.526928 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-980924d5-264e-4bcd-a053-5f86d352f5d4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1510 microversion: 2.1 time: 0.155323 Sep 19 12:42:52.527508 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 546/1080] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:52 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:52.549510 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-04050dac-1c6f-436a-b53c-99a620ab5599 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:42:52.550129 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-04050dac-1c6f-436a-b53c-99a620ab5599 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:52.556446 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-04050dac-1c6f-436a-b53c-99a620ab5599 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:52.556948 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-04050dac-1c6f-436a-b53c-99a620ab5599 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:52.557374 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-04050dac-1c6f-436a-b53c-99a620ab5599 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:52.558048 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-04050dac-1c6f-436a-b53c-99a620ab5599 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:52.558489 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-04050dac-1c6f-436a-b53c-99a620ab5599 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:52.558903 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-04050dac-1c6f-436a-b53c-99a620ab5599 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:52.589489 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-04050dac-1c6f-436a-b53c-99a620ab5599 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121428) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 12:42:52.924144 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-04050dac-1c6f-436a-b53c-99a620ab5599 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "POST /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0/action" status: 202 len: 0 microversion: 2.1 time: 0.378524 Sep 19 12:42:52.924774 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 535/1081] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Sep 19 12:42:52 2022] POST /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:42:52.933049 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-9fc4ecbb-8644-466d-8a84-4f26168a1194 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:52.933665 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-9fc4ecbb-8644-466d-8a84-4f26168a1194 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:52.940076 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9fc4ecbb-8644-466d-8a84-4f26168a1194 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:52.940590 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9fc4ecbb-8644-466d-8a84-4f26168a1194 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:52.941258 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9fc4ecbb-8644-466d-8a84-4f26168a1194 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:52.941960 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9fc4ecbb-8644-466d-8a84-4f26168a1194 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:52.942410 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9fc4ecbb-8644-466d-8a84-4f26168a1194 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:52.942831 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-9fc4ecbb-8644-466d-8a84-4f26168a1194 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:52.961034 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=100 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:42:53.084536 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-9fc4ecbb-8644-466d-8a84-4f26168a1194 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:53.092877 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-9fc4ecbb-8644-466d-8a84-4f26168a1194 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1518 microversion: 2.1 time: 0.163383 Sep 19 12:42:53.093499 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 547/1082] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:52 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:54.116634 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-43561674-efb3-4244-aaa9-c1f329466414 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:54.117283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-43561674-efb3-4244-aaa9-c1f329466414 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:54.123414 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-43561674-efb3-4244-aaa9-c1f329466414 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:54.123889 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-43561674-efb3-4244-aaa9-c1f329466414 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:54.124809 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-43561674-efb3-4244-aaa9-c1f329466414 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:54.125503 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-43561674-efb3-4244-aaa9-c1f329466414 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:54.125944 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-43561674-efb3-4244-aaa9-c1f329466414 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:54.126360 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-43561674-efb3-4244-aaa9-c1f329466414 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:54.262556 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-43561674-efb3-4244-aaa9-c1f329466414 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:54.270219 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-43561674-efb3-4244-aaa9-c1f329466414 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1518 microversion: 2.1 time: 0.158122 Sep 19 12:42:54.270784 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 536/1083] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:54 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:55.126931 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-fa8b04fa-9a11-487b-8364-360b0a28d19f req-384fa0ce-a1ba-4d9a-8b93-609727d4a783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0ba5ed-539d-4219-8066-bed154fc37f0", "name": "network-vif-unplugged", "status": "completed", "tag": "b8557e4d-5a65-4fe0-94ef-88821e1bd60d"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:42:55.137025 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-fa8b04fa-9a11-487b-8364-360b0a28d19f req-384fa0ce-a1ba-4d9a-8b93-609727d4a783 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:55.137420 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-fa8b04fa-9a11-487b-8364-360b0a28d19f req-384fa0ce-a1ba-4d9a-8b93-609727d4a783 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:55.137852 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-fa8b04fa-9a11-487b-8364-360b0a28d19f req-384fa0ce-a1ba-4d9a-8b93-609727d4a783 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:55.149443 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.compute.server_external_events [req-fa8b04fa-9a11-487b-8364-360b0a28d19f req-384fa0ce-a1ba-4d9a-8b93-609727d4a783 service nova] Unable to find a host for instance 9e0ba5ed-539d-4219-8066-bed154fc37f0. Dropping event network-vif-unplugged {{(pid=121429) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 19 12:42:55.150319 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-fa8b04fa-9a11-487b-8364-360b0a28d19f req-384fa0ce-a1ba-4d9a-8b93-609727d4a783 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027384 Sep 19 12:42:55.150891 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 548/1084] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 19 12:42:55.293433 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-b7e01de5-4fba-43c6-90a2-5b4e68b21a43 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:55.294182 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-b7e01de5-4fba-43c6-90a2-5b4e68b21a43 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:55.301354 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b7e01de5-4fba-43c6-90a2-5b4e68b21a43 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:55.301838 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b7e01de5-4fba-43c6-90a2-5b4e68b21a43 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:55.302277 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b7e01de5-4fba-43c6-90a2-5b4e68b21a43 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:55.302974 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b7e01de5-4fba-43c6-90a2-5b4e68b21a43 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:55.303426 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b7e01de5-4fba-43c6-90a2-5b4e68b21a43 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:55.303847 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-b7e01de5-4fba-43c6-90a2-5b4e68b21a43 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:55.439636 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-b7e01de5-4fba-43c6-90a2-5b4e68b21a43 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:55.447348 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-b7e01de5-4fba-43c6-90a2-5b4e68b21a43 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1520 microversion: 2.1 time: 0.157886 Sep 19 12:42:55.447909 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 537/1085] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:55 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:56.471370 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-65f2d3e8-701c-4d5e-862c-a4b37f58d1ec tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:56.472178 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-65f2d3e8-701c-4d5e-862c-a4b37f58d1ec tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:56.478813 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-65f2d3e8-701c-4d5e-862c-a4b37f58d1ec tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:56.479301 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-65f2d3e8-701c-4d5e-862c-a4b37f58d1ec tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:56.479727 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-65f2d3e8-701c-4d5e-862c-a4b37f58d1ec tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:56.480414 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-65f2d3e8-701c-4d5e-862c-a4b37f58d1ec tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:56.480908 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-65f2d3e8-701c-4d5e-862c-a4b37f58d1ec tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:56.481328 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-65f2d3e8-701c-4d5e-862c-a4b37f58d1ec tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:56.613908 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-65f2d3e8-701c-4d5e-862c-a4b37f58d1ec tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:56.621760 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-65f2d3e8-701c-4d5e-862c-a4b37f58d1ec tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1576 microversion: 2.1 time: 0.154933 Sep 19 12:42:56.622612 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 549/1086] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:56 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:57.646040 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c2287506-81c0-4e8e-ae05-b1d1502801a1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:57.646668 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c2287506-81c0-4e8e-ae05-b1d1502801a1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:57.648972 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:42:57.653585 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c2287506-81c0-4e8e-ae05-b1d1502801a1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:57.654056 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c2287506-81c0-4e8e-ae05-b1d1502801a1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:57.654480 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c2287506-81c0-4e8e-ae05-b1d1502801a1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:57.655152 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c2287506-81c0-4e8e-ae05-b1d1502801a1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:57.656104 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c2287506-81c0-4e8e-ae05-b1d1502801a1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:57.656514 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c2287506-81c0-4e8e-ae05-b1d1502801a1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:57.790220 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c2287506-81c0-4e8e-ae05-b1d1502801a1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:57.799047 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c2287506-81c0-4e8e-ae05-b1d1502801a1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1576 microversion: 2.1 time: 0.156832 Sep 19 12:42:57.799724 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 538/1087] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:57 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:58.822564 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-fb7a63da-f84d-43cd-9570-110e0b2bab26 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:58.823167 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-fb7a63da-f84d-43cd-9570-110e0b2bab26 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:42:58.825523 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=51 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:42:58.830673 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fb7a63da-f84d-43cd-9570-110e0b2bab26 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:58.831145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fb7a63da-f84d-43cd-9570-110e0b2bab26 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:58.831576 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fb7a63da-f84d-43cd-9570-110e0b2bab26 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:58.832312 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fb7a63da-f84d-43cd-9570-110e0b2bab26 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:42:58.832781 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fb7a63da-f84d-43cd-9570-110e0b2bab26 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:42:58.839477 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-fb7a63da-f84d-43cd-9570-110e0b2bab26 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:42:58.962772 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-fb7a63da-f84d-43cd-9570-110e0b2bab26 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:42:58.971144 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-fb7a63da-f84d-43cd-9570-110e0b2bab26 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1576 microversion: 2.1 time: 0.152434 Sep 19 12:42:58.971712 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 550/1088] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:58 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:42:59.994901 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-2b18a9af-7824-440c-9d5c-330d5fe98c10 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:42:59.995507 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-2b18a9af-7824-440c-9d5c-330d5fe98c10 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:43:00.002639 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2b18a9af-7824-440c-9d5c-330d5fe98c10 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:43:00.003110 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2b18a9af-7824-440c-9d5c-330d5fe98c10 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:43:00.003538 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2b18a9af-7824-440c-9d5c-330d5fe98c10 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:43:00.004215 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2b18a9af-7824-440c-9d5c-330d5fe98c10 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:43:00.004683 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2b18a9af-7824-440c-9d5c-330d5fe98c10 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:43:00.005100 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2b18a9af-7824-440c-9d5c-330d5fe98c10 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:43:00.139169 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-2b18a9af-7824-440c-9d5c-330d5fe98c10 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:43:00.147760 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-2b18a9af-7824-440c-9d5c-330d5fe98c10 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1576 microversion: 2.1 time: 0.157129 Sep 19 12:43:00.148407 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 539/1089] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:42:59 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:43:01.171849 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-afb37bd3-dbb1-4871-9646-41e293f4bfbf tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:43:01.172450 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-afb37bd3-dbb1-4871-9646-41e293f4bfbf tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:43:01.179226 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-afb37bd3-dbb1-4871-9646-41e293f4bfbf tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:43:01.179717 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-afb37bd3-dbb1-4871-9646-41e293f4bfbf tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:43:01.180150 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-afb37bd3-dbb1-4871-9646-41e293f4bfbf tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:43:01.180872 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-afb37bd3-dbb1-4871-9646-41e293f4bfbf tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:43:01.181320 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-afb37bd3-dbb1-4871-9646-41e293f4bfbf tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:43:01.181742 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-afb37bd3-dbb1-4871-9646-41e293f4bfbf tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:43:01.312015 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-afb37bd3-dbb1-4871-9646-41e293f4bfbf tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:43:01.325586 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-afb37bd3-dbb1-4871-9646-41e293f4bfbf tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1576 microversion: 2.1 time: 0.157542 Sep 19 12:43:01.326176 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 551/1090] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:43:01 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:43:02.349639 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-39e03038-0f28-4f58-bcb6-371c0d769548 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:43:02.350242 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-39e03038-0f28-4f58-bcb6-371c0d769548 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:43:02.356751 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-39e03038-0f28-4f58-bcb6-371c0d769548 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:43:02.357229 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-39e03038-0f28-4f58-bcb6-371c0d769548 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:43:02.357656 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-39e03038-0f28-4f58-bcb6-371c0d769548 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:43:02.358339 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-39e03038-0f28-4f58-bcb6-371c0d769548 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:43:02.359584 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-39e03038-0f28-4f58-bcb6-371c0d769548 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:43:02.360009 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-39e03038-0f28-4f58-bcb6-371c0d769548 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:43:02.490889 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-39e03038-0f28-4f58-bcb6-371c0d769548 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:43:02.499020 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-39e03038-0f28-4f58-bcb6-371c0d769548 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1576 microversion: 2.1 time: 0.153405 Sep 19 12:43:02.499572 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 540/1091] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:43:02 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:43:03.521988 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2f9c3ea1-ed8b-4cad-aed1-afc3aef79cab tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:43:03.522597 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2f9c3ea1-ed8b-4cad-aed1-afc3aef79cab tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:43:03.529263 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2f9c3ea1-ed8b-4cad-aed1-afc3aef79cab tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:43:03.529759 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2f9c3ea1-ed8b-4cad-aed1-afc3aef79cab tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:43:03.530196 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2f9c3ea1-ed8b-4cad-aed1-afc3aef79cab tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:43:03.531450 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2f9c3ea1-ed8b-4cad-aed1-afc3aef79cab tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:43:03.531907 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2f9c3ea1-ed8b-4cad-aed1-afc3aef79cab tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:43:03.532333 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2f9c3ea1-ed8b-4cad-aed1-afc3aef79cab tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:43:03.666275 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2f9c3ea1-ed8b-4cad-aed1-afc3aef79cab tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:43:03.674038 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2f9c3ea1-ed8b-4cad-aed1-afc3aef79cab tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1576 microversion: 2.1 time: 0.155946 Sep 19 12:43:03.674610 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 552/1092] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:43:03 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:43:04.698334 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-3a9d907f-f3b2-48bd-8faa-71dde3dd7fd9 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:43:04.698988 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-3a9d907f-f3b2-48bd-8faa-71dde3dd7fd9 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:43:04.706774 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3a9d907f-f3b2-48bd-8faa-71dde3dd7fd9 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:43:04.707256 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3a9d907f-f3b2-48bd-8faa-71dde3dd7fd9 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:43:04.707686 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3a9d907f-f3b2-48bd-8faa-71dde3dd7fd9 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:43:04.708386 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3a9d907f-f3b2-48bd-8faa-71dde3dd7fd9 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:43:04.708883 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3a9d907f-f3b2-48bd-8faa-71dde3dd7fd9 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:43:04.709294 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-3a9d907f-f3b2-48bd-8faa-71dde3dd7fd9 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:43:04.838645 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-3a9d907f-f3b2-48bd-8faa-71dde3dd7fd9 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:43:04.846770 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-3a9d907f-f3b2-48bd-8faa-71dde3dd7fd9 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1576 microversion: 2.1 time: 0.152350 Sep 19 12:43:04.847337 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 541/1093] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:43:04 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:43:05.869931 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4e6439d6-c78d-4ddf-84ca-00043277f542 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:43:05.870546 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4e6439d6-c78d-4ddf-84ca-00043277f542 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:43:05.877803 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4e6439d6-c78d-4ddf-84ca-00043277f542 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:43:05.878279 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4e6439d6-c78d-4ddf-84ca-00043277f542 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:43:05.878709 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4e6439d6-c78d-4ddf-84ca-00043277f542 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:43:05.879393 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4e6439d6-c78d-4ddf-84ca-00043277f542 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:43:05.879838 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4e6439d6-c78d-4ddf-84ca-00043277f542 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:43:05.880253 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4e6439d6-c78d-4ddf-84ca-00043277f542 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:43:06.021454 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-4e6439d6-c78d-4ddf-84ca-00043277f542 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:43:06.029190 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4e6439d6-c78d-4ddf-84ca-00043277f542 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1576 microversion: 2.1 time: 0.163249 Sep 19 12:43:06.029758 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 553/1094] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:43:05 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:43:07.052331 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c6aa4bfd-6011-432b-a1d5-e6a6cc5f5e74 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:43:07.052969 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c6aa4bfd-6011-432b-a1d5-e6a6cc5f5e74 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:43:07.059017 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c6aa4bfd-6011-432b-a1d5-e6a6cc5f5e74 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:43:07.059491 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c6aa4bfd-6011-432b-a1d5-e6a6cc5f5e74 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:43:07.059948 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c6aa4bfd-6011-432b-a1d5-e6a6cc5f5e74 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:43:07.060653 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c6aa4bfd-6011-432b-a1d5-e6a6cc5f5e74 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:43:07.061098 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c6aa4bfd-6011-432b-a1d5-e6a6cc5f5e74 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:43:07.061513 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c6aa4bfd-6011-432b-a1d5-e6a6cc5f5e74 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:43:07.195533 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c6aa4bfd-6011-432b-a1d5-e6a6cc5f5e74 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:43:07.203770 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c6aa4bfd-6011-432b-a1d5-e6a6cc5f5e74 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1576 microversion: 2.1 time: 0.155710 Sep 19 12:43:07.204366 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 542/1095] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:43:07 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:43:07.358279 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-d8a58442-d8e7-4d83-a472-0229aff967b6 req-3e22ee75-9ab0-4ac3-9272-63fcfbd35f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0ba5ed-539d-4219-8066-bed154fc37f0", "name": "network-vif-plugged", "status": "completed", "tag": "b8557e4d-5a65-4fe0-94ef-88821e1bd60d"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:43:07.369491 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-d8a58442-d8e7-4d83-a472-0229aff967b6 req-3e22ee75-9ab0-4ac3-9272-63fcfbd35f6d service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:43:07.369966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-d8a58442-d8e7-4d83-a472-0229aff967b6 req-3e22ee75-9ab0-4ac3-9272-63fcfbd35f6d service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:43:07.370400 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-d8a58442-d8e7-4d83-a472-0229aff967b6 req-3e22ee75-9ab0-4ac3-9272-63fcfbd35f6d service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:43:07.381382 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-d8a58442-d8e7-4d83-a472-0229aff967b6 req-3e22ee75-9ab0-4ac3-9272-63fcfbd35f6d service nova] Creating event network-vif-plugged:b8557e4d-5a65-4fe0-94ef-88821e1bd60d for instance 9e0ba5ed-539d-4219-8066-bed154fc37f0 on hv-cinder-85061 Sep 19 12:43:07.386417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-d8a58442-d8e7-4d83-a472-0229aff967b6 req-3e22ee75-9ab0-4ac3-9272-63fcfbd35f6d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031780 Sep 19 12:43:07.387010 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 554/1096] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:43:08.226220 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-f65db78e-23bd-4131-a464-751a219cdd7e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:43:08.226906 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-f65db78e-23bd-4131-a464-751a219cdd7e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:43:08.233188 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f65db78e-23bd-4131-a464-751a219cdd7e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:43:08.233644 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f65db78e-23bd-4131-a464-751a219cdd7e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:43:08.234071 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f65db78e-23bd-4131-a464-751a219cdd7e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:43:08.234745 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f65db78e-23bd-4131-a464-751a219cdd7e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:43:08.235189 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f65db78e-23bd-4131-a464-751a219cdd7e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:43:08.235637 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-f65db78e-23bd-4131-a464-751a219cdd7e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:43:08.367829 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-f65db78e-23bd-4131-a464-751a219cdd7e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:43:08.375737 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-f65db78e-23bd-4131-a464-751a219cdd7e tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1576 microversion: 2.1 time: 0.153388 Sep 19 12:43:08.376301 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 543/1097] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:43:08 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:43:09.400518 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e1243d4f-7784-4016-889b-be790933cda4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:43:09.401362 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-e1243d4f-7784-4016-889b-be790933cda4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:43:09.407460 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e1243d4f-7784-4016-889b-be790933cda4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:43:09.408620 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e1243d4f-7784-4016-889b-be790933cda4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:43:09.409118 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e1243d4f-7784-4016-889b-be790933cda4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:43:09.409814 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e1243d4f-7784-4016-889b-be790933cda4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:43:09.410269 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e1243d4f-7784-4016-889b-be790933cda4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:43:09.410689 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e1243d4f-7784-4016-889b-be790933cda4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:43:09.550433 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e1243d4f-7784-4016-889b-be790933cda4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:43:09.558270 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e1243d4f-7784-4016-889b-be790933cda4 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1563 microversion: 2.1 time: 0.162563 Sep 19 12:43:09.558996 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 555/1098] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:43:09 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:44:29.760127 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_api:SELECT=11 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:44:29.761260 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG dbcounter [-] [121428] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:44:29.762836 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_api:SELECT=11 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:44:29.763585 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG dbcounter [-] [121429] Writing DB stats nova_cell1:SELECT=42 {{(pid=121429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:44:29.766301 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-2469369f-eb62-470b-b42a-e72dccdcde80 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:29.767025 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-2469369f-eb62-470b-b42a-e72dccdcde80 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:29.768319 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-2c817a12-7bcf-43a1-941e-91cf8e468250 req-f1443daa-a2b5-43bd-91fa-2ea11317ff28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e0ba5ed-539d-4219-8066-bed154fc37f0", "tag": "b8557e4d-5a65-4fe0-94ef-88821e1bd60d"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:44:29.774609 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2469369f-eb62-470b-b42a-e72dccdcde80 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:29.779777 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2469369f-eb62-470b-b42a-e72dccdcde80 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:29.779777 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2469369f-eb62-470b-b42a-e72dccdcde80 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:29.779777 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2469369f-eb62-470b-b42a-e72dccdcde80 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:29.779777 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2469369f-eb62-470b-b42a-e72dccdcde80 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:29.780254 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-2469369f-eb62-470b-b42a-e72dccdcde80 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:29.780367 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-2c817a12-7bcf-43a1-941e-91cf8e468250 req-f1443daa-a2b5-43bd-91fa-2ea11317ff28 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:29.780367 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-2c817a12-7bcf-43a1-941e-91cf8e468250 req-f1443daa-a2b5-43bd-91fa-2ea11317ff28 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:29.780367 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-2c817a12-7bcf-43a1-941e-91cf8e468250 req-f1443daa-a2b5-43bd-91fa-2ea11317ff28 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:29.793950 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-2c817a12-7bcf-43a1-941e-91cf8e468250 req-f1443daa-a2b5-43bd-91fa-2ea11317ff28 service nova] Creating event network-changed:b8557e4d-5a65-4fe0-94ef-88821e1bd60d for instance 9e0ba5ed-539d-4219-8066-bed154fc37f0 on hv-cinder-85061 Sep 19 12:44:29.799339 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-2c817a12-7bcf-43a1-941e-91cf8e468250 req-f1443daa-a2b5-43bd-91fa-2ea11317ff28 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038217 Sep 19 12:44:29.800225 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 556/1099] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:44:29.805325 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-2469369f-eb62-470b-b42a-e72dccdcde80 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Going to try to terminate instance {{(pid=121428) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:44:30.210586 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-2469369f-eb62-470b-b42a-e72dccdcde80 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 204 len: 0 microversion: 2.1 time: 0.452699 Sep 19 12:44:30.211309 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 544/1100] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:44:29 2022] DELETE /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:44:30.221453 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-63b8001c-47e0-4e91-a113-03639775e94d tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:30.222389 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-63b8001c-47e0-4e91-a113-03639775e94d tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:30.229020 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-63b8001c-47e0-4e91-a113-03639775e94d tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:30.229932 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-63b8001c-47e0-4e91-a113-03639775e94d tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:30.230561 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-63b8001c-47e0-4e91-a113-03639775e94d tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:30.231289 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-63b8001c-47e0-4e91-a113-03639775e94d tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:30.231905 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-63b8001c-47e0-4e91-a113-03639775e94d tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:30.232323 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-63b8001c-47e0-4e91-a113-03639775e94d tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:30.382535 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-63b8001c-47e0-4e91-a113-03639775e94d tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:44:30.392241 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-63b8001c-47e0-4e91-a113-03639775e94d tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1569 microversion: 2.1 time: 0.175662 Sep 19 12:44:30.393265 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 557/1101] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:30 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:44:31.229048 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-4747b6d4-aee8-4f82-966d-2ee5f16de564 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:31.229633 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-4747b6d4-aee8-4f82-966d-2ee5f16de564 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:31.236495 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4747b6d4-aee8-4f82-966d-2ee5f16de564 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:31.238681 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4747b6d4-aee8-4f82-966d-2ee5f16de564 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:31.238681 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4747b6d4-aee8-4f82-966d-2ee5f16de564 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:31.238681 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4747b6d4-aee8-4f82-966d-2ee5f16de564 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:31.238681 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4747b6d4-aee8-4f82-966d-2ee5f16de564 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:31.239094 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4747b6d4-aee8-4f82-966d-2ee5f16de564 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:31.264937 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-4747b6d4-aee8-4f82-966d-2ee5f16de564 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Going to try to terminate instance {{(pid=121428) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:44:31.415344 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3a2307d6-23eb-4960-b573-ab319cc2a10c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:31.416130 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3a2307d6-23eb-4960-b573-ab319cc2a10c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:31.423079 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3a2307d6-23eb-4960-b573-ab319cc2a10c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:31.423625 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3a2307d6-23eb-4960-b573-ab319cc2a10c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:31.424066 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3a2307d6-23eb-4960-b573-ab319cc2a10c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:31.424809 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3a2307d6-23eb-4960-b573-ab319cc2a10c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:31.425263 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3a2307d6-23eb-4960-b573-ab319cc2a10c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:31.425689 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3a2307d6-23eb-4960-b573-ab319cc2a10c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:31.563781 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3a2307d6-23eb-4960-b573-ab319cc2a10c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:44:31.572496 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3a2307d6-23eb-4960-b573-ab319cc2a10c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1569 microversion: 2.1 time: 0.161031 Sep 19 12:44:31.573227 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 558/1102] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:31 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:44:31.642808 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-4747b6d4-aee8-4f82-966d-2ee5f16de564 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "DELETE /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 204 len: 0 microversion: 2.1 time: 0.418527 Sep 19 12:44:31.643402 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 545/1103] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:44:31 2022] DELETE /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:44:31.652393 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4a06903e-e7ca-40a3-a0ed-083bf2b20fdb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:31.653046 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4a06903e-e7ca-40a3-a0ed-083bf2b20fdb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:31.659055 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a06903e-e7ca-40a3-a0ed-083bf2b20fdb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:31.659788 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a06903e-e7ca-40a3-a0ed-083bf2b20fdb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:31.660230 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a06903e-e7ca-40a3-a0ed-083bf2b20fdb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:31.660969 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a06903e-e7ca-40a3-a0ed-083bf2b20fdb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:31.661416 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a06903e-e7ca-40a3-a0ed-083bf2b20fdb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:31.662036 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a06903e-e7ca-40a3-a0ed-083bf2b20fdb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:31.797994 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-4a06903e-e7ca-40a3-a0ed-083bf2b20fdb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:44:31.810802 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4a06903e-e7ca-40a3-a0ed-083bf2b20fdb tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1579 microversion: 2.1 time: 0.158211 Sep 19 12:44:31.810802 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 559/1104] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:31 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:44:31.815923 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-6f2a1066-a844-496f-8e8a-666ba2325489 req-b259e57c-f526-404d-a9d8-6c167cda3693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911e4970-9926-4489-bbba-294c19734f5e", "tag": "8f965105-2928-43e8-bcc0-3ed7aef6d87f"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:44:31.826629 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-6f2a1066-a844-496f-8e8a-666ba2325489 req-b259e57c-f526-404d-a9d8-6c167cda3693 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:31.827424 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-6f2a1066-a844-496f-8e8a-666ba2325489 req-b259e57c-f526-404d-a9d8-6c167cda3693 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:31.827853 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-6f2a1066-a844-496f-8e8a-666ba2325489 req-b259e57c-f526-404d-a9d8-6c167cda3693 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:31.839777 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-6f2a1066-a844-496f-8e8a-666ba2325489 req-b259e57c-f526-404d-a9d8-6c167cda3693 service nova] Creating event network-changed:8f965105-2928-43e8-bcc0-3ed7aef6d87f for instance 911e4970-9926-4489-bbba-294c19734f5e on hv-cinder-85061 Sep 19 12:44:31.845542 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-6f2a1066-a844-496f-8e8a-666ba2325489 req-b259e57c-f526-404d-a9d8-6c167cda3693 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034599 Sep 19 12:44:31.852271 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 546/1105] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:44:32.596201 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-1c04fa20-3977-4768-9f76-de9d199046fd tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:32.596859 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-1c04fa20-3977-4768-9f76-de9d199046fd tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:32.603882 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c04fa20-3977-4768-9f76-de9d199046fd tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:32.604357 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c04fa20-3977-4768-9f76-de9d199046fd tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:32.604827 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c04fa20-3977-4768-9f76-de9d199046fd tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:32.605511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c04fa20-3977-4768-9f76-de9d199046fd tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:32.605957 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c04fa20-3977-4768-9f76-de9d199046fd tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:32.606373 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-1c04fa20-3977-4768-9f76-de9d199046fd tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:32.736408 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-1c04fa20-3977-4768-9f76-de9d199046fd tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:44:32.744108 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-1c04fa20-3977-4768-9f76-de9d199046fd tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1450 microversion: 2.1 time: 0.152648 Sep 19 12:44:32.744708 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 560/1106] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:32 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:44:32.832150 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-61f37512-2036-42c7-b12e-dbbc58112c55 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:32.832897 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-61f37512-2036-42c7-b12e-dbbc58112c55 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:32.839862 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-61f37512-2036-42c7-b12e-dbbc58112c55 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:32.840408 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-61f37512-2036-42c7-b12e-dbbc58112c55 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:32.840861 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-61f37512-2036-42c7-b12e-dbbc58112c55 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:32.841572 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-61f37512-2036-42c7-b12e-dbbc58112c55 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:32.842041 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-61f37512-2036-42c7-b12e-dbbc58112c55 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:32.842475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-61f37512-2036-42c7-b12e-dbbc58112c55 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:32.971378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-61f37512-2036-42c7-b12e-dbbc58112c55 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:44:32.979045 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-61f37512-2036-42c7-b12e-dbbc58112c55 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1579 microversion: 2.1 time: 0.151554 Sep 19 12:44:32.979610 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 547/1107] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:32 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1579 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:44:33.767418 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-2f7f8518-97ff-43ff-a147-7a8029407eb6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:33.768225 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-2f7f8518-97ff-43ff-a147-7a8029407eb6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:33.775679 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2f7f8518-97ff-43ff-a147-7a8029407eb6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:33.777194 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2f7f8518-97ff-43ff-a147-7a8029407eb6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:33.777347 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2f7f8518-97ff-43ff-a147-7a8029407eb6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:33.778050 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2f7f8518-97ff-43ff-a147-7a8029407eb6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:33.778506 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2f7f8518-97ff-43ff-a147-7a8029407eb6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:33.778940 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-2f7f8518-97ff-43ff-a147-7a8029407eb6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:34.002201 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e9dac3ba-7ce1-4fd6-92c3-d6c507fac84a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:34.002949 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-e9dac3ba-7ce1-4fd6-92c3-d6c507fac84a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:34.010437 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e9dac3ba-7ce1-4fd6-92c3-d6c507fac84a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:34.010939 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e9dac3ba-7ce1-4fd6-92c3-d6c507fac84a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:34.011437 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e9dac3ba-7ce1-4fd6-92c3-d6c507fac84a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:34.012204 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e9dac3ba-7ce1-4fd6-92c3-d6c507fac84a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:34.012749 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e9dac3ba-7ce1-4fd6-92c3-d6c507fac84a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:34.013172 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-e9dac3ba-7ce1-4fd6-92c3-d6c507fac84a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:34.444206 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-2f7f8518-97ff-43ff-a147-7a8029407eb6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:44:34.452101 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-2f7f8518-97ff-43ff-a147-7a8029407eb6 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1450 microversion: 2.1 time: 0.688802 Sep 19 12:44:34.452911 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 561/1108] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:33 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1450 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:44:34.701094 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-e9dac3ba-7ce1-4fd6-92c3-d6c507fac84a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:44:34.708996 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e9dac3ba-7ce1-4fd6-92c3-d6c507fac84a tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1579 microversion: 2.1 time: 0.710687 Sep 19 12:44:34.709574 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 548/1109] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:33 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1579 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:44:35.475213 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-c457ad4e-df14-4bee-bb2e-3508c7005df5 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:35.475807 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-c457ad4e-df14-4bee-bb2e-3508c7005df5 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:35.482511 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c457ad4e-df14-4bee-bb2e-3508c7005df5 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:35.482998 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c457ad4e-df14-4bee-bb2e-3508c7005df5 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:35.483432 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c457ad4e-df14-4bee-bb2e-3508c7005df5 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:35.484132 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c457ad4e-df14-4bee-bb2e-3508c7005df5 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:35.484594 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c457ad4e-df14-4bee-bb2e-3508c7005df5 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:35.485030 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-c457ad4e-df14-4bee-bb2e-3508c7005df5 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:35.493306 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [req-fee00afd-fa83-49f8-9b94-5a5e6bdff19d req-c4687c86-4d4c-4250-8f50-10e18277847d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0ba5ed-539d-4219-8066-bed154fc37f0", "name": "network-vif-deleted", "tag": "b8557e4d-5a65-4fe0-94ef-88821e1bd60d"}]} {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:44:35.504888 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-fee00afd-fa83-49f8-9b94-5a5e6bdff19d req-c4687c86-4d4c-4250-8f50-10e18277847d service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:35.505340 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-fee00afd-fa83-49f8-9b94-5a5e6bdff19d req-c4687c86-4d4c-4250-8f50-10e18277847d service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:35.508495 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [req-fee00afd-fa83-49f8-9b94-5a5e6bdff19d req-c4687c86-4d4c-4250-8f50-10e18277847d service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:35.518197 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.compute.server_external_events [req-fee00afd-fa83-49f8-9b94-5a5e6bdff19d req-c4687c86-4d4c-4250-8f50-10e18277847d service nova] Creating event network-vif-deleted:b8557e4d-5a65-4fe0-94ef-88821e1bd60d for instance 9e0ba5ed-539d-4219-8066-bed154fc37f0 on hv-cinder-85061 Sep 19 12:44:35.523432 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [req-fee00afd-fa83-49f8-9b94-5a5e6bdff19d req-c4687c86-4d4c-4250-8f50-10e18277847d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097335 Sep 19 12:44:35.524497 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 562/1110] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:44:35.553255 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-c457ad4e-df14-4bee-bb2e-3508c7005df5 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:44:35.562854 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-c457ad4e-df14-4bee-bb2e-3508c7005df5 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1383 microversion: 2.1 time: 0.091477 Sep 19 12:44:35.563435 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 549/1111] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:35 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1383 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:44:35.735634 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3b5ee0d1-3dc4-4f09-a8b7-951c7d3845e4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:35.736429 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3b5ee0d1-3dc4-4f09-a8b7-951c7d3845e4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:35.744561 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b5ee0d1-3dc4-4f09-a8b7-951c7d3845e4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:35.745593 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b5ee0d1-3dc4-4f09-a8b7-951c7d3845e4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:35.746133 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b5ee0d1-3dc4-4f09-a8b7-951c7d3845e4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:35.747203 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b5ee0d1-3dc4-4f09-a8b7-951c7d3845e4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:35.747763 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b5ee0d1-3dc4-4f09-a8b7-951c7d3845e4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:35.748410 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3b5ee0d1-3dc4-4f09-a8b7-951c7d3845e4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:35.826656 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-3b5ee0d1-3dc4-4f09-a8b7-951c7d3845e4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:44:35.839024 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3b5ee0d1-3dc4-4f09-a8b7-951c7d3845e4 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1225 microversion: 2.1 time: 0.107892 Sep 19 12:44:35.839942 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 563/1112] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:35 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:44:36.586859 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-6418a101-09b9-44a6-91c0-7753777d6f28 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:36.587464 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-6418a101-09b9-44a6-91c0-7753777d6f28 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:36.593462 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6418a101-09b9-44a6-91c0-7753777d6f28 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:36.593947 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6418a101-09b9-44a6-91c0-7753777d6f28 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:36.594384 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6418a101-09b9-44a6-91c0-7753777d6f28 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:36.595075 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6418a101-09b9-44a6-91c0-7753777d6f28 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:36.595521 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6418a101-09b9-44a6-91c0-7753777d6f28 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:36.595942 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6418a101-09b9-44a6-91c0-7753777d6f28 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:36.628060 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6418a101-09b9-44a6-91c0-7753777d6f28 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:36.628544 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6418a101-09b9-44a6-91c0-7753777d6f28 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:36.629124 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-6418a101-09b9-44a6-91c0-7753777d6f28 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:36.629637 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-6418a101-09b9-44a6-91c0-7753777d6f28 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lazy-loading 'fault' on Instance uuid 9e0ba5ed-539d-4219-8066-bed154fc37f0 {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:44:36.681678 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-6418a101-09b9-44a6-91c0-7753777d6f28 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:44:36.684475 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-6418a101-09b9-44a6-91c0-7753777d6f28 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1224 microversion: 2.1 time: 0.102224 Sep 19 12:44:36.685071 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 550/1113] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:36 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:44:36.863572 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-356917ab-1725-4695-85c4-d9c799034338 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:36.864106 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-356917ab-1725-4695-85c4-d9c799034338 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:36.870875 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-356917ab-1725-4695-85c4-d9c799034338 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:36.871358 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-356917ab-1725-4695-85c4-d9c799034338 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:36.871791 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-356917ab-1725-4695-85c4-d9c799034338 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:36.872731 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-356917ab-1725-4695-85c4-d9c799034338 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:36.873192 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-356917ab-1725-4695-85c4-d9c799034338 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:36.873620 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-356917ab-1725-4695-85c4-d9c799034338 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:36.906043 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-356917ab-1725-4695-85c4-d9c799034338 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:36.906528 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-356917ab-1725-4695-85c4-d9c799034338 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:36.906962 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-356917ab-1725-4695-85c4-d9c799034338 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:36.907406 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.objects.instance [None req-356917ab-1725-4695-85c4-d9c799034338 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lazy-loading 'fault' on Instance uuid 911e4970-9926-4489-bbba-294c19734f5e {{(pid=121429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:44:36.949453 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-356917ab-1725-4695-85c4-d9c799034338 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:44:36.957292 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-356917ab-1725-4695-85c4-d9c799034338 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 200 len: 1230 microversion: 2.1 time: 0.097689 Sep 19 12:44:36.958070 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 564/1114] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:36 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:44:37.542567 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-3bd57887-fd24-47ea-867a-229aa219c429 req-bcf40236-9a7a-4660-9f7b-63c810f57cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911e4970-9926-4489-bbba-294c19734f5e", "name": "network-vif-deleted", "tag": "8f965105-2928-43e8-bcc0-3ed7aef6d87f"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:44:37.551698 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-3bd57887-fd24-47ea-867a-229aa219c429 req-bcf40236-9a7a-4660-9f7b-63c810f57cb0 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:37.552167 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-3bd57887-fd24-47ea-867a-229aa219c429 req-bcf40236-9a7a-4660-9f7b-63c810f57cb0 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:37.552588 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-3bd57887-fd24-47ea-867a-229aa219c429 req-bcf40236-9a7a-4660-9f7b-63c810f57cb0 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:37.563541 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-3bd57887-fd24-47ea-867a-229aa219c429 req-bcf40236-9a7a-4660-9f7b-63c810f57cb0 service nova] Creating event network-vif-deleted:8f965105-2928-43e8-bcc0-3ed7aef6d87f for instance 911e4970-9926-4489-bbba-294c19734f5e on hv-cinder-85061 Sep 19 12:44:37.568452 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-3bd57887-fd24-47ea-867a-229aa219c429 req-bcf40236-9a7a-4660-9f7b-63c810f57cb0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030305 Sep 19 12:44:37.569516 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 551/1115] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:44:37.706722 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-4a7374e1-d2db-4ed0-8b4d-ded669f7e2d7 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:37.707329 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-4a7374e1-d2db-4ed0-8b4d-ded669f7e2d7 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:37.713705 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a7374e1-d2db-4ed0-8b4d-ded669f7e2d7 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:37.721299 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a7374e1-d2db-4ed0-8b4d-ded669f7e2d7 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:37.721299 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a7374e1-d2db-4ed0-8b4d-ded669f7e2d7 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:37.721299 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a7374e1-d2db-4ed0-8b4d-ded669f7e2d7 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:37.721299 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a7374e1-d2db-4ed0-8b4d-ded669f7e2d7 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:37.721711 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a7374e1-d2db-4ed0-8b4d-ded669f7e2d7 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:37.747076 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a7374e1-d2db-4ed0-8b4d-ded669f7e2d7 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:37.747557 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a7374e1-d2db-4ed0-8b4d-ded669f7e2d7 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:37.748478 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-4a7374e1-d2db-4ed0-8b4d-ded669f7e2d7 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:37.748478 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.objects.instance [None req-4a7374e1-d2db-4ed0-8b4d-ded669f7e2d7 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lazy-loading 'fault' on Instance uuid 9e0ba5ed-539d-4219-8066-bed154fc37f0 {{(pid=121429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:44:37.792118 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-4a7374e1-d2db-4ed0-8b4d-ded669f7e2d7 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14737ebdbfe243cca926c7b02b0018a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdacab5c564ab29d54ea189755adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:44:37.800517 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-4a7374e1-d2db-4ed0-8b4d-ded669f7e2d7 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 200 len: 1224 microversion: 2.1 time: 0.097630 Sep 19 12:44:37.801144 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 565/1116] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:37 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:44:37.982713 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d10e58f7-f4c5-4cc7-abf2-4493a2590bcd tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:37.983402 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-d10e58f7-f4c5-4cc7-abf2-4493a2590bcd tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 911e4970-9926-4489-bbba-294c19734f5e] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:37.989467 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d10e58f7-f4c5-4cc7-abf2-4493a2590bcd tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:37.989958 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d10e58f7-f4c5-4cc7-abf2-4493a2590bcd tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:37.990389 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d10e58f7-f4c5-4cc7-abf2-4493a2590bcd tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:37.991099 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d10e58f7-f4c5-4cc7-abf2-4493a2590bcd tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:37.991541 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d10e58f7-f4c5-4cc7-abf2-4493a2590bcd tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:37.991955 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-d10e58f7-f4c5-4cc7-abf2-4493a2590bcd tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:38.005335 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-d10e58f7-f4c5-4cc7-abf2-4493a2590bcd tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] HTTP exception thrown: Instance 911e4970-9926-4489-bbba-294c19734f5e could not be found. Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d10e58f7-f4c5-4cc7-abf2-4493a2590bcd tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Request method failure captured: Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e HTTP/1.1 Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKGKFQselOfs1QEh-qTYPIrguOyCEeD2fZGLo2RFYh96s4MStrL1_qQqjEiHcriSmkJJYo_SyMt1dtqARwwnD84hn7DksaiKUNFcNLb8JLHO29J88PcTEbHKrN61MB-6KO0gHe_tVkXUMLM1MLYv7aEmfnY463-JIOWVZeBqGxZYItF4 Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: ea2bd5c94eb7415c80a4e24452c08eb4 Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-TestVolumeBootPattern-452559673 Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:44:38.006952 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:44:38.009378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ea2bd5c94eb7415c80a4e24452c08eb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ea2bd5c94eb7415c80a4e24452c08eb4", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ea2bd5c94eb7415c80a4e24452c08eb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ea2bd5c94eb7415c80a4e24452c08eb4"}]}] Sep 19 12:44:38.009378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-TestVolumeBootPattern-452559673 Sep 19 12:44:38.009378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: ea2bd5c94eb7415c80a4e24452c08eb4 Sep 19 12:44:38.009378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-TestVolumeBootPattern-452559673 Sep 19 12:44:38.009378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-TestVolumeBootPattern-452559673-project Sep 19 12:44:38.009378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:44:38.009378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:44:38.009378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: 88b8a34360fa4595a07c7d3610563b77 Sep 19 12:44:38.009378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-TestVolumeBootPattern-452559673-project Sep 19 12:44:38.009378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:44:38.009378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance 911e4970-9926-4489-bbba-294c19734f5e could not be found. Sep 19 12:44:38.009378 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': '911e4970-9926-4489-bbba-294c19734f5e'} Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 911e4970-9926-4489-bbba-294c19734f5e could not be found. Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:44:38.011186 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:44:38.012892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:44:38.012892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:44:38.012892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:44:38.012892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:44:38.012892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:44:38.012892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:44:38.012892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:44:38.012892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 911e4970-9926-4489-bbba-294c19734f5e could not be found. Sep 19 12:44:38.012892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:44:38.012892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:44:38.012892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:44:38.012892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:44:38.012892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:44:38.012892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:44:38.012892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:44:38.012892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:44:38.012892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 911e4970-9926-4489-bbba-294c19734f5e could not be found. Sep 19 12:44:38.012892 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:44:38.014611 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-d10e58f7-f4c5-4cc7-abf2-4493a2590bcd tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Returning 404 to user: Instance 911e4970-9926-4489-bbba-294c19734f5e could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:44:38.014611 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-d10e58f7-f4c5-4cc7-abf2-4493a2590bcd tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e" status: 404 len: 111 microversion: 2.1 time: 0.030979 Sep 19 12:44:38.014611 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 552/1117] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:37 2022] GET /compute/v2.1/servers/911e4970-9926-4489-bbba-294c19734f5e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:44:38.824055 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-07edcb7d-8a9c-45c5-88c3-a7ebbbb4a85c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:38.824721 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-07edcb7d-8a9c-45c5-88c3-a7ebbbb4a85c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] [instance: 9e0ba5ed-539d-4219-8066-bed154fc37f0] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:38.831699 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-07edcb7d-8a9c-45c5-88c3-a7ebbbb4a85c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:38.832175 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-07edcb7d-8a9c-45c5-88c3-a7ebbbb4a85c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:38.833165 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-07edcb7d-8a9c-45c5-88c3-a7ebbbb4a85c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:38.833855 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-07edcb7d-8a9c-45c5-88c3-a7ebbbb4a85c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:38.834304 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-07edcb7d-8a9c-45c5-88c3-a7ebbbb4a85c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:38.834746 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-07edcb7d-8a9c-45c5-88c3-a7ebbbb4a85c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:38.848407 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-07edcb7d-8a9c-45c5-88c3-a7ebbbb4a85c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] HTTP exception thrown: Instance 9e0ba5ed-539d-4219-8066-bed154fc37f0 could not be found. Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-07edcb7d-8a9c-45c5-88c3-a7ebbbb4a85c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Request method failure captured: Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 HTTP/1.1 Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKGMVfKXXPn5Zvy7NEblfMTRT6LCI4Lsa6F_AaPI4-CI_KH_Gl6Pk9epk09wrsTnFON5BR3DKWu2jPinPHmDDzaMSMLQOvBYO2l6F2sYz8Ls_OTpO9M2M6zimwYjJdf9Z4OBmw5GXUcbtWCTGiO8w2c3HhNLUgjpifKUo4xaR_E9GErg Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: 00cdacab5c564ab29d54ea189755adb0 Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-TestShelveInstance-853468263 Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:44:38.850256 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:44:38.852417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00cdacab5c564ab29d54ea189755adb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_00cdacab5c564ab29d54ea189755adb0", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00cdacab5c564ab29d54ea189755adb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/00cdacab5c564ab29d54ea189755adb0"}]}] Sep 19 12:44:38.852417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-TestShelveInstance-853468263 Sep 19 12:44:38.852417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: 00cdacab5c564ab29d54ea189755adb0 Sep 19 12:44:38.852417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-TestShelveInstance-853468263 Sep 19 12:44:38.852417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-TestShelveInstance-853468263-project Sep 19 12:44:38.852417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:44:38.852417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:44:38.852417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 14737ebdbfe243cca926c7b02b0018a0 Sep 19 12:44:38.852417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-TestShelveInstance-853468263-project Sep 19 12:44:38.852417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:44:38.852417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance 9e0ba5ed-539d-4219-8066-bed154fc37f0 could not be found. Sep 19 12:44:38.852417 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': '9e0ba5ed-539d-4219-8066-bed154fc37f0'} Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e0ba5ed-539d-4219-8066-bed154fc37f0 could not be found. Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:44:38.853356 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:44:38.856639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:44:38.856639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:44:38.856639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:44:38.856639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:44:38.856639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:44:38.856639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:44:38.856639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:44:38.856639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e0ba5ed-539d-4219-8066-bed154fc37f0 could not be found. Sep 19 12:44:38.856639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:44:38.856639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:44:38.856639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:44:38.856639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:44:38.856639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:44:38.856639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:44:38.856639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:44:38.856639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:44:38.856639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e0ba5ed-539d-4219-8066-bed154fc37f0 could not be found. Sep 19 12:44:38.856639 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:44:38.860329 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-07edcb7d-8a9c-45c5-88c3-a7ebbbb4a85c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Returning 404 to user: Instance 9e0ba5ed-539d-4219-8066-bed154fc37f0 could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:44:38.860329 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-07edcb7d-8a9c-45c5-88c3-a7ebbbb4a85c tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0" status: 404 len: 111 microversion: 2.1 time: 0.032218 Sep 19 12:44:38.860329 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 566/1118] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:38 2022] GET /compute/v2.1/servers/9e0ba5ed-539d-4219-8066-bed154fc37f0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:44:39.137298 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-e51d205f-f266-4990-9130-24d41772a3f1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] Calling method '.version_select at 0x7f54b378d160>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:39.228385 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-e51d205f-f266-4990-9130-24d41772a3f1 tempest-TestShelveInstance-853468263 tempest-TestShelveInstance-853468263-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1037177663" status: 202 len: 0 microversion: 2.1 time: 0.092910 Sep 19 12:44:39.229011 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 553/1119] 10.222.0.93 () {58 vars in 1254 bytes} [Mon Sep 19 12:44:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1037177663 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:44:41.523531 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-8dcb9b57-0afe-45e8-a0f5-6284d96152cf req-1872e9ad-193b-4774-9559-66386f31ad51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5c59bf-6037-4a1c-b6be-bd677f066903", "tag": "92a0d280-ad6f-4cdd-958b-f758f5800ced"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:44:41.524573 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-3aa76b9a-6504-4d98-9ae2-6aac6d90f219 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:41.524573 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3aa76b9a-6504-4d98-9ae2-6aac6d90f219 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:41.532066 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3aa76b9a-6504-4d98-9ae2-6aac6d90f219 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:41.532976 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3aa76b9a-6504-4d98-9ae2-6aac6d90f219 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:41.534137 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3aa76b9a-6504-4d98-9ae2-6aac6d90f219 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:41.535035 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3aa76b9a-6504-4d98-9ae2-6aac6d90f219 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:41.536358 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3aa76b9a-6504-4d98-9ae2-6aac6d90f219 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:41.537004 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-3aa76b9a-6504-4d98-9ae2-6aac6d90f219 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:41.537713 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-8dcb9b57-0afe-45e8-a0f5-6284d96152cf req-1872e9ad-193b-4774-9559-66386f31ad51 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:41.541412 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-8dcb9b57-0afe-45e8-a0f5-6284d96152cf req-1872e9ad-193b-4774-9559-66386f31ad51 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:41.541412 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-8dcb9b57-0afe-45e8-a0f5-6284d96152cf req-1872e9ad-193b-4774-9559-66386f31ad51 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:41.550825 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-8dcb9b57-0afe-45e8-a0f5-6284d96152cf req-1872e9ad-193b-4774-9559-66386f31ad51 service nova] Creating event network-changed:92a0d280-ad6f-4cdd-958b-f758f5800ced for instance 0e5c59bf-6037-4a1c-b6be-bd677f066903 on hv-cinder-85061 Sep 19 12:44:41.558819 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-8dcb9b57-0afe-45e8-a0f5-6284d96152cf req-1872e9ad-193b-4774-9559-66386f31ad51 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039153 Sep 19 12:44:41.559993 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 554/1120] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:44:41.572792 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-3aa76b9a-6504-4d98-9ae2-6aac6d90f219 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Going to try to terminate instance {{(pid=121429) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:44:42.046847 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-3aa76b9a-6504-4d98-9ae2-6aac6d90f219 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 204 len: 0 microversion: 2.1 time: 0.529699 Sep 19 12:44:42.047806 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 567/1121] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:44:41 2022] DELETE /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:44:42.057573 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-743e5bb2-5991-4fdc-a078-de556e196d28 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:42.058283 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-743e5bb2-5991-4fdc-a078-de556e196d28 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:42.064711 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-743e5bb2-5991-4fdc-a078-de556e196d28 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:42.065209 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-743e5bb2-5991-4fdc-a078-de556e196d28 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:42.065649 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-743e5bb2-5991-4fdc-a078-de556e196d28 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:42.066517 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-743e5bb2-5991-4fdc-a078-de556e196d28 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:42.067073 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-743e5bb2-5991-4fdc-a078-de556e196d28 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:42.067530 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-743e5bb2-5991-4fdc-a078-de556e196d28 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:42.252248 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-743e5bb2-5991-4fdc-a078-de556e196d28 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:44:42.261457 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-743e5bb2-5991-4fdc-a078-de556e196d28 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1578 microversion: 2.1 time: 0.208992 Sep 19 12:44:42.262425 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 555/1122] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:42 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1578 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:44:43.289448 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-26ec1465-359e-4819-930a-9dfca974dbff tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:43.290150 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-26ec1465-359e-4819-930a-9dfca974dbff tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:43.296511 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-26ec1465-359e-4819-930a-9dfca974dbff tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:43.299032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-26ec1465-359e-4819-930a-9dfca974dbff tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:43.299032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-26ec1465-359e-4819-930a-9dfca974dbff tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:43.299032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-26ec1465-359e-4819-930a-9dfca974dbff tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:43.299032 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-26ec1465-359e-4819-930a-9dfca974dbff tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:43.299425 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-26ec1465-359e-4819-930a-9dfca974dbff tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:43.491101 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-26ec1465-359e-4819-930a-9dfca974dbff tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:44:43.500937 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-26ec1465-359e-4819-930a-9dfca974dbff tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1578 microversion: 2.1 time: 0.215683 Sep 19 12:44:43.502481 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 568/1123] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:43 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1578 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:44:44.409240 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [req-eb8e2369-cac3-4156-8f4c-bdd81370f3f2 req-eb2b6a91-e31a-4db3-9c71-ff6e35bb2117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5c59bf-6037-4a1c-b6be-bd677f066903", "name": "network-vif-deleted", "tag": "92a0d280-ad6f-4cdd-958b-f758f5800ced"}]} {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:44:44.420108 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-eb8e2369-cac3-4156-8f4c-bdd81370f3f2 req-eb2b6a91-e31a-4db3-9c71-ff6e35bb2117 service nova] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:44.420590 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-eb8e2369-cac3-4156-8f4c-bdd81370f3f2 req-eb2b6a91-e31a-4db3-9c71-ff6e35bb2117 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:44.421047 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [req-eb8e2369-cac3-4156-8f4c-bdd81370f3f2 req-eb2b6a91-e31a-4db3-9c71-ff6e35bb2117 service nova] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:44.434601 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.compute.server_external_events [req-eb8e2369-cac3-4156-8f4c-bdd81370f3f2 req-eb2b6a91-e31a-4db3-9c71-ff6e35bb2117 service nova] Creating event network-vif-deleted:92a0d280-ad6f-4cdd-958b-f758f5800ced for instance 0e5c59bf-6037-4a1c-b6be-bd677f066903 on hv-cinder-85061 Sep 19 12:44:44.443135 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [req-eb8e2369-cac3-4156-8f4c-bdd81370f3f2 req-eb2b6a91-e31a-4db3-9c71-ff6e35bb2117 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037693 Sep 19 12:44:44.444134 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 556/1124] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Sep 19 12:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:44:44.526344 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-e15b3c7d-3952-4c4c-b322-8ed24b22ba62 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:44.528774 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-e15b3c7d-3952-4c4c-b322-8ed24b22ba62 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:44.534825 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e15b3c7d-3952-4c4c-b322-8ed24b22ba62 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:44.535593 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e15b3c7d-3952-4c4c-b322-8ed24b22ba62 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:44.536259 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e15b3c7d-3952-4c4c-b322-8ed24b22ba62 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:44.537018 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e15b3c7d-3952-4c4c-b322-8ed24b22ba62 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:44.537475 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e15b3c7d-3952-4c4c-b322-8ed24b22ba62 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:44.537904 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-e15b3c7d-3952-4c4c-b322-8ed24b22ba62 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:44.607180 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.policy [None req-e15b3c7d-3952-4c4c-b322-8ed24b22ba62 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121429) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:44:44.616067 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-e15b3c7d-3952-4c4c-b322-8ed24b22ba62 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1391 microversion: 2.1 time: 0.093869 Sep 19 12:44:44.616659 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 569/1125] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:44 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1391 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:44:45.643070 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-ef4f251d-6605-48dc-ae70-feba5743878c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:45.643679 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-ef4f251d-6605-48dc-ae70-feba5743878c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:45.651982 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ef4f251d-6605-48dc-ae70-feba5743878c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:45.652466 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ef4f251d-6605-48dc-ae70-feba5743878c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:45.652926 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ef4f251d-6605-48dc-ae70-feba5743878c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:45.653629 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ef4f251d-6605-48dc-ae70-feba5743878c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:45.654727 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ef4f251d-6605-48dc-ae70-feba5743878c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:45.655391 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ef4f251d-6605-48dc-ae70-feba5743878c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:45.690360 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ef4f251d-6605-48dc-ae70-feba5743878c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:45.690835 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ef4f251d-6605-48dc-ae70-feba5743878c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:45.691265 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-ef4f251d-6605-48dc-ae70-feba5743878c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:45.691706 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.objects.instance [None req-ef4f251d-6605-48dc-ae70-feba5743878c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lazy-loading 'fault' on Instance uuid 0e5c59bf-6037-4a1c-b6be-bd677f066903 {{(pid=121428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:44:45.770304 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.policy [None req-ef4f251d-6605-48dc-ae70-feba5743878c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b8a34360fa4595a07c7d3610563b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2bd5c94eb7415c80a4e24452c08eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121428) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:44:45.794157 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-ef4f251d-6605-48dc-ae70-feba5743878c tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 200 len: 1230 microversion: 2.1 time: 0.155375 Sep 19 12:44:45.794902 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 557/1126] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:45 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 1230 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:44:46.826310 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-98350959-0596-4e0f-b8ee-218c308e70aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:46.826992 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-98350959-0596-4e0f-b8ee-218c308e70aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 0e5c59bf-6037-4a1c-b6be-bd677f066903] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:46.836971 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-98350959-0596-4e0f-b8ee-218c308e70aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:46.837461 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-98350959-0596-4e0f-b8ee-218c308e70aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:46.838187 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-98350959-0596-4e0f-b8ee-218c308e70aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:46.838895 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-98350959-0596-4e0f-b8ee-218c308e70aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:46.839350 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-98350959-0596-4e0f-b8ee-218c308e70aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:46.839777 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-98350959-0596-4e0f-b8ee-218c308e70aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:46.854443 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-98350959-0596-4e0f-b8ee-218c308e70aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] HTTP exception thrown: Instance 0e5c59bf-6037-4a1c-b6be-bd677f066903 could not be found. Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-98350959-0596-4e0f-b8ee-218c308e70aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Request method failure captured: Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 HTTP/1.1 Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKGKFQselOfs1QEh-qTYPIrguOyCEeD2fZGLo2RFYh96s4MStrL1_qQqjEiHcriSmkJJYo_SyMt1dtqARwwnD84hn7DksaiKUNFcNLb8JLHO29J88PcTEbHKrN61MB-6KO0gHe_tVkXUMLM1MLYv7aEmfnY463-JIOWVZeBqGxZYItF4 Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: ea2bd5c94eb7415c80a4e24452c08eb4 Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-TestVolumeBootPattern-452559673 Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:44:46.856485 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:44:46.858145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ea2bd5c94eb7415c80a4e24452c08eb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ea2bd5c94eb7415c80a4e24452c08eb4", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ea2bd5c94eb7415c80a4e24452c08eb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ea2bd5c94eb7415c80a4e24452c08eb4"}]}] Sep 19 12:44:46.858145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-TestVolumeBootPattern-452559673 Sep 19 12:44:46.858145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: ea2bd5c94eb7415c80a4e24452c08eb4 Sep 19 12:44:46.858145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-TestVolumeBootPattern-452559673 Sep 19 12:44:46.858145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-TestVolumeBootPattern-452559673-project Sep 19 12:44:46.858145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:44:46.858145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:44:46.858145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 88b8a34360fa4595a07c7d3610563b77 Sep 19 12:44:46.858145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-TestVolumeBootPattern-452559673-project Sep 19 12:44:46.858145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:44:46.858145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance 0e5c59bf-6037-4a1c-b6be-bd677f066903 could not be found. Sep 19 12:44:46.858145 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': '0e5c59bf-6037-4a1c-b6be-bd677f066903'} Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e5c59bf-6037-4a1c-b6be-bd677f066903 could not be found. Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:44:46.858966 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:44:46.860719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:44:46.860719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:44:46.860719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:44:46.860719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:44:46.860719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:44:46.860719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:44:46.860719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:44:46.860719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e5c59bf-6037-4a1c-b6be-bd677f066903 could not be found. Sep 19 12:44:46.860719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:44:46.860719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:44:46.860719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:44:46.860719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:44:46.860719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:44:46.860719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:44:46.860719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:44:46.860719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:44:46.860719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e5c59bf-6037-4a1c-b6be-bd677f066903 could not be found. Sep 19 12:44:46.860719 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:44:46.862193 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-98350959-0596-4e0f-b8ee-218c308e70aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Returning 404 to user: Instance 0e5c59bf-6037-4a1c-b6be-bd677f066903 could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:44:46.862193 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-98350959-0596-4e0f-b8ee-218c308e70aa tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903" status: 404 len: 111 microversion: 2.1 time: 0.041827 Sep 19 12:44:46.862715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 570/1127] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:46 2022] GET /compute/v2.1/servers/0e5c59bf-6037-4a1c-b6be-bd677f066903 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:44:47.660364 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-4f78d73f-b5d8-4602-9d2e-dd2cb8810ed8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:47.660886 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.compute.api [None req-4f78d73f-b5d8-4602-9d2e-dd2cb8810ed8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121428) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:47.667731 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4f78d73f-b5d8-4602-9d2e-dd2cb8810ed8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:47.673466 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4f78d73f-b5d8-4602-9d2e-dd2cb8810ed8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:47.673466 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4f78d73f-b5d8-4602-9d2e-dd2cb8810ed8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:47.673466 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4f78d73f-b5d8-4602-9d2e-dd2cb8810ed8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:47.673466 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4f78d73f-b5d8-4602-9d2e-dd2cb8810ed8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:47.673870 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG oslo_concurrency.lockutils [None req-4f78d73f-b5d8-4602-9d2e-dd2cb8810ed8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:47.685400 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.wsgi [None req-4f78d73f-b5d8-4602-9d2e-dd2cb8810ed8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] HTTP exception thrown: Instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a could not be found. Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-4f78d73f-b5d8-4602-9d2e-dd2cb8810ed8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Request method failure captured: Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: request: DELETE /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a HTTP/1.1 Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept: application/json Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Accept-Encoding: identity Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Connection: close Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Length: 0 Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Content-Type: application/json Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Host: 10.222.0.93 Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: Openstack-System-Scope: None Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: User-Agent: python-urllib3/1.26.12 Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Auth-Token: gAAAAABjKGKFQselOfs1QEh-qTYPIrguOyCEeD2fZGLo2RFYh96s4MStrL1_qQqjEiHcriSmkJJYo_SyMt1dtqARwwnD84hn7DksaiKUNFcNLb8JLHO29J88PcTEbHKrN61MB-6KO0gHe_tVkXUMLM1MLYv7aEmfnY463-JIOWVZeBqGxZYItF4 Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Id: None Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Domain-Name: None Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Identity-Status: Confirmed Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Is-Admin-Project: True Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Id: default Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Domain-Name: Default Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Id: ea2bd5c94eb7415c80a4e24452c08eb4 Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Project-Name: tempest-TestVolumeBootPattern-452559673 Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Role: reader,member Sep 19 12:44:47.687082 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Roles: reader,member Sep 19 12:44:47.689023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ea2bd5c94eb7415c80a4e24452c08eb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ea2bd5c94eb7415c80a4e24452c08eb4", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ea2bd5c94eb7415c80a4e24452c08eb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ea2bd5c94eb7415c80a4e24452c08eb4"}]}] Sep 19 12:44:47.689023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant: tempest-TestVolumeBootPattern-452559673 Sep 19 12:44:47.689023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Id: ea2bd5c94eb7415c80a4e24452c08eb4 Sep 19 12:44:47.689023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-Tenant-Name: tempest-TestVolumeBootPattern-452559673 Sep 19 12:44:47.689023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User: tempest-TestVolumeBootPattern-452559673-project Sep 19 12:44:47.689023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Id: default Sep 19 12:44:47.689023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Domain-Name: Default Sep 19 12:44:47.689023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Id: 88b8a34360fa4595a07c7d3610563b77 Sep 19 12:44:47.689023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: X-User-Name: tempest-TestVolumeBootPattern-452559673-project Sep 19 12:44:47.689023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: method: > Sep 19 12:44:47.689023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: exception: Instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a could not be found. Sep 19 12:44:47.689023 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: action_args: {'id': '8e74d99e-308c-42c2-b0e4-41a594c0db6a'} Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a could not be found. Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:44:47.689983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a could not be found. Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a could not be found. Sep 19 12:44:47.691591 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: ERROR nova.api.openstack.wsgi Sep 19 12:44:47.693193 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-4f78d73f-b5d8-4602-9d2e-dd2cb8810ed8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Returning 404 to user: Instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a could not be found. {{(pid=121428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:44:47.693193 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-4f78d73f-b5d8-4602-9d2e-dd2cb8810ed8 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 404 len: 111 microversion: 2.1 time: 0.031961 Sep 19 12:44:47.693193 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 558/1128] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Sep 19 12:44:47 2022] DELETE /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:44:47.697544 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-301507b3-9d95-474f-9414-2426e7040487 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '>' {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:47.698169 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.compute.api [None req-301507b3-9d95-474f-9414-2426e7040487 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] [instance: 8e74d99e-308c-42c2-b0e4-41a594c0db6a] Fetching instance by UUID {{(pid=121429) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:44:47.704532 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-301507b3-9d95-474f-9414-2426e7040487 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:47.705110 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-301507b3-9d95-474f-9414-2426e7040487 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:47.705551 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-301507b3-9d95-474f-9414-2426e7040487 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:47.709701 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-301507b3-9d95-474f-9414-2426e7040487 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Acquiring lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:44:47.709701 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-301507b3-9d95-474f-9414-2426e7040487 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:44:47.709701 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG oslo_concurrency.lockutils [None req-301507b3-9d95-474f-9414-2426e7040487 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Lock "f85a1a4f-73ae-4199-a51b-3478744f2b7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:44:47.721142 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.wsgi [None req-301507b3-9d95-474f-9414-2426e7040487 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] HTTP exception thrown: Instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a could not be found. Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-301507b3-9d95-474f-9414-2426e7040487 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Request method failure captured: Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: request: GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a HTTP/1.1 Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept: application/json Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Accept-Encoding: identity Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Connection: close Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Length: 0 Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Content-Type: application/json Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Host: 10.222.0.93 Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: Openstack-System-Scope: None Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: User-Agent: python-urllib3/1.26.12 Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Auth-Token: gAAAAABjKGKFQselOfs1QEh-qTYPIrguOyCEeD2fZGLo2RFYh96s4MStrL1_qQqjEiHcriSmkJJYo_SyMt1dtqARwwnD84hn7DksaiKUNFcNLb8JLHO29J88PcTEbHKrN61MB-6KO0gHe_tVkXUMLM1MLYv7aEmfnY463-JIOWVZeBqGxZYItF4 Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Id: None Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Domain-Name: None Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Identity-Status: Confirmed Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Is-Admin-Project: True Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Id: default Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Domain-Name: Default Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Id: ea2bd5c94eb7415c80a4e24452c08eb4 Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Project-Name: tempest-TestVolumeBootPattern-452559673 Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Role: reader,member Sep 19 12:44:47.722715 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Roles: reader,member Sep 19 12:44:47.724438 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ea2bd5c94eb7415c80a4e24452c08eb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ea2bd5c94eb7415c80a4e24452c08eb4", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ea2bd5c94eb7415c80a4e24452c08eb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ea2bd5c94eb7415c80a4e24452c08eb4"}]}] Sep 19 12:44:47.724438 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant: tempest-TestVolumeBootPattern-452559673 Sep 19 12:44:47.724438 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Id: ea2bd5c94eb7415c80a4e24452c08eb4 Sep 19 12:44:47.724438 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-Tenant-Name: tempest-TestVolumeBootPattern-452559673 Sep 19 12:44:47.724438 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User: tempest-TestVolumeBootPattern-452559673-project Sep 19 12:44:47.724438 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Id: default Sep 19 12:44:47.724438 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Domain-Name: Default Sep 19 12:44:47.724438 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Id: 88b8a34360fa4595a07c7d3610563b77 Sep 19 12:44:47.724438 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: X-User-Name: tempest-TestVolumeBootPattern-452559673-project Sep 19 12:44:47.724438 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: method: > Sep 19 12:44:47.724438 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: exception: Instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a could not be found. Sep 19 12:44:47.724438 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: action_args: {'id': '8e74d99e-308c-42c2-b0e4-41a594c0db6a'} Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: {{(pid=121429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a could not be found. Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:44:47.725458 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:44:47.727538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:44:47.727538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:44:47.727538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:44:47.727538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:44:47.727538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:44:47.727538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:44:47.727538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:44:47.727538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a could not be found. Sep 19 12:44:47.727538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:44:47.727538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:44:47.727538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:44:47.727538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:44:47.727538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:44:47.727538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:44:47.727538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:44:47.727538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:44:47.727538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a could not be found. Sep 19 12:44:47.727538 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: ERROR nova.api.openstack.wsgi Sep 19 12:44:47.729118 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: DEBUG nova.api.openstack.wsgi [None req-301507b3-9d95-474f-9414-2426e7040487 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Returning 404 to user: Instance 8e74d99e-308c-42c2-b0e4-41a594c0db6a could not be found. {{(pid=121429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:44:47.729118 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: INFO nova.api.openstack.requestlog [None req-301507b3-9d95-474f-9414-2426e7040487 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a" status: 404 len: 111 microversion: 2.1 time: 0.030473 Sep 19 12:44:47.729118 dv-cinder-850618-3-iscsi devstack@n-api.service[121429]: [pid: 121429|app: 0|req: 571/1129] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Sep 19 12:44:47 2022] GET /compute/v2.1/servers/8e74d99e-308c-42c2-b0e4-41a594c0db6a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:44:49.428983 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: DEBUG nova.api.openstack.wsgi [None req-4567f78c-9760-43bf-8cfc-1ae507ad6e94 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] Calling method '.version_select at 0x7f54b3982ee0>' {{(pid=121428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:44:49.559783 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: INFO nova.api.openstack.requestlog [None req-4567f78c-9760-43bf-8cfc-1ae507ad6e94 tempest-TestVolumeBootPattern-452559673 tempest-TestVolumeBootPattern-452559673-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1129654240" status: 202 len: 0 microversion: 2.1 time: 0.134824 Sep 19 12:44:49.560367 dv-cinder-850618-3-iscsi devstack@n-api.service[121428]: [pid: 121428|app: 0|req: 559/1130] 10.222.0.93 () {58 vars in 1263 bytes} [Mon Sep 19 12:44:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1129654240 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)